Oct 31 07:27:31.683166 ip-10-0-136-217 systemd[1]: Starting Kubernetes Kubelet... Oct 31 07:27:32.123111 ip-10-0-136-217 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:27:32.123111 ip-10-0-136-217 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 07:27:32.123111 ip-10-0-136-217 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:27:32.123111 ip-10-0-136-217 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129537 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129624 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129629 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129633 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129638 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.129631 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129641 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129644 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129647 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129652 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129654 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129657 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129660 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129662 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129665 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129668 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129670 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129673 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129676 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129679 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129682 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129684 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129694 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129697 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129700 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129702 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.129850 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129705 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129708 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129710 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129713 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129716 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129719 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129721 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129723 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129726 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129729 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129732 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129735 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129738 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129741 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129746 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129748 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129751 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129754 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129756 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129759 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.130326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129762 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129764 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129767 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129770 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129772 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129775 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129778 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129781 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129784 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129787 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129789 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129792 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129795 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129797 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129800 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129802 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129805 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129807 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129810 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129813 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.130796 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129815 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129818 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129820 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129823 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129825 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129830 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129835 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129839 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129843 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129846 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129849 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129852 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129855 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129858 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129861 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129864 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129866 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129869 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129873 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.131283 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129875 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129878 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129896 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129899 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129902 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129906 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129910 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129913 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129916 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129919 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129921 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129924 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129927 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129929 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129934 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129936 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129939 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129942 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129945 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.131723 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129948 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129951 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.129954 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130770 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130777 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130780 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130783 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130785 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130789 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130792 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130794 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130797 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130800 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130803 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130806 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130809 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130812 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130814 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130817 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130820 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.132208 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130823 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130825 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130828 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130831 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130833 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130836 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130838 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130841 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130844 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130846 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130849 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130852 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130856 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130858 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130861 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130864 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130867 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130869 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130872 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130874 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.132684 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130877 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130880 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130897 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130900 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130902 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130905 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130908 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130911 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130914 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130916 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130919 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130921 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130924 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130926 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130929 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130931 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130934 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130936 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130940 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130942 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.133162 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130945 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130948 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130950 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130953 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130956 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130958 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130961 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130963 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130966 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130968 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130971 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130974 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130976 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130979 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130981 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130984 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130986 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130989 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130991 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.133630 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130994 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130997 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.130999 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131002 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131004 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131007 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131009 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131012 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131015 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131017 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131020 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131023 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131025 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131028 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131031 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131033 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131036 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131039 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131041 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.134079 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131044 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131046 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131049 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131051 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131054 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131057 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131060 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131062 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131066 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131070 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131075 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131585 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131590 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131593 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131596 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131598 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131601 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131603 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131606 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.135235 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131608 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131611 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131615 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131619 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131623 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131626 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131630 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131632 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131635 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131638 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131640 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131643 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131647 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131649 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131652 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131654 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131657 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131659 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131662 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.135688 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131665 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131667 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131669 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131672 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131674 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131677 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131679 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131682 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131684 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131687 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131690 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131692 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131696 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131700 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131704 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131706 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131709 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131712 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131714 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.136147 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131717 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131720 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131722 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131725 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131728 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131733 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131735 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131738 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131741 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131743 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131747 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131749 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131752 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131754 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131757 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131760 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131763 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131765 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131767 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131770 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.136585 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131773 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131775 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131778 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131781 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131783 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131787 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131790 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131792 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131795 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131797 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131800 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131803 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131805 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131808 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131811 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131813 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131816 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131819 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131821 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.137075 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131824 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131827 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131829 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131832 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131834 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131837 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131839 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131842 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131845 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131847 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131850 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131852 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131855 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131858 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131860 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131863 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131866 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131868 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131872 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131875 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.137532 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.131877 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133519 2584 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133531 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133550 2584 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133559 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133564 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133567 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133572 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133576 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133579 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133583 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133587 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133590 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133593 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133596 2584 flags.go:64] FLAG: --cgroup-root="" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133600 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133603 2584 flags.go:64] FLAG: --client-ca-file="" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133606 2584 flags.go:64] FLAG: --cloud-provider="external" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133608 2584 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133612 2584 flags.go:64] FLAG: --cluster-domain="" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133615 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133618 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133622 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133625 2584 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 07:27:32.138012 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133629 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133632 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133636 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133639 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133643 2584 flags.go:64] FLAG: --contention-profiling="false" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133646 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133650 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133653 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133656 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133661 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133664 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133667 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133670 2584 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133673 2584 flags.go:64] FLAG: --enable-server="true" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133676 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133680 2584 flags.go:64] FLAG: --event-burst="100" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133683 2584 flags.go:64] FLAG: --event-qps="50" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133686 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133689 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133692 2584 flags.go:64] FLAG: --eviction-hard="" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133697 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133699 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133702 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133706 2584 flags.go:64] FLAG: --eviction-soft="" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133709 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 07:27:32.138578 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133712 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133715 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133718 2584 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133721 2584 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133724 2584 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133727 2584 flags.go:64] FLAG: --feature-gates="" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133731 2584 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133734 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133738 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133741 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133744 2584 flags.go:64] FLAG: --healthz-port="10248" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133747 2584 flags.go:64] FLAG: --help="false" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133750 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133754 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133757 2584 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133760 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133763 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133767 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133770 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133773 2584 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133776 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133779 2584 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133781 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133785 2584 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 07:27:32.139212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133788 2584 flags.go:64] FLAG: --kube-reserved="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133791 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133793 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133796 2584 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133799 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133802 2584 flags.go:64] FLAG: --lock-file="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133805 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133808 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133811 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133817 2584 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133821 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133824 2584 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133827 2584 flags.go:64] FLAG: --logging-format="text" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133830 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133833 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133836 2584 flags.go:64] FLAG: --manifest-url="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133839 2584 flags.go:64] FLAG: --manifest-url-header="" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133844 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133847 2584 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133851 2584 flags.go:64] FLAG: --max-pods="110" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133854 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133857 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133860 2584 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133863 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133866 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 07:27:32.139783 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133869 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133872 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133890 2584 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133894 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133897 2584 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133900 2584 flags.go:64] FLAG: --pod-cidr="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133903 2584 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133906 2584 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133911 2584 flags.go:64] FLAG: --pods-per-core="0" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133914 2584 flags.go:64] FLAG: --port="10250" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133917 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133920 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0203c7dddc93d4d78" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133924 2584 flags.go:64] FLAG: --qos-reserved="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133927 2584 flags.go:64] FLAG: --read-only-port="10255" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133930 2584 flags.go:64] FLAG: --register-node="true" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133932 2584 flags.go:64] FLAG: --register-with-taints="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133936 2584 flags.go:64] FLAG: --registry-burst="10" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133939 2584 flags.go:64] FLAG: --registry-qps="5" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133942 2584 flags.go:64] FLAG: --reserved-cpus="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133945 2584 flags.go:64] FLAG: --reserved-memory="" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133948 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133952 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133955 2584 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133957 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133960 2584 flags.go:64] FLAG: --runonce="false" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133963 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 07:27:32.140390 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133967 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133970 2584 flags.go:64] FLAG: --seccomp-default="false" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133973 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133976 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133980 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133983 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133986 2584 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133990 2584 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133992 2584 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133995 2584 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.133998 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134001 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134004 2584 flags.go:64] FLAG: --system-cgroups="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134007 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134014 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134017 2584 flags.go:64] FLAG: --tls-cert-file="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134020 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134023 2584 flags.go:64] FLAG: --tls-min-version="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134026 2584 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134028 2584 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134031 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134035 2584 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134038 2584 flags.go:64] FLAG: --v="2" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134042 2584 flags.go:64] FLAG: --version="false" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134047 2584 flags.go:64] FLAG: --vmodule="" Oct 31 07:27:32.141471 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134051 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134054 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134205 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134209 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134212 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134215 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134217 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134222 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134225 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134228 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134231 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134233 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134237 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134240 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134242 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134245 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134247 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134250 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134253 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134255 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.142558 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134258 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134262 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134264 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134267 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134270 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134273 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134275 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134278 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134281 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134283 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134286 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134290 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134292 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134295 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134297 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134300 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134304 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134308 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134311 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.143415 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134315 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134318 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134321 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134323 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134326 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134328 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134332 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134334 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134337 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134339 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134342 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134344 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134347 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134350 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134354 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134356 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134359 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134362 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134364 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.144267 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134367 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134369 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134372 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134374 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134377 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134380 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134382 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134386 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134388 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134391 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134393 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134396 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134399 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134403 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134405 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134408 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134410 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134413 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134416 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.145225 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134426 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134430 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134433 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134436 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134438 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134441 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134443 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134446 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134450 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134453 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134455 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134458 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134460 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134463 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134465 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134468 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134471 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134473 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134476 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134478 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.145906 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134481 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134485 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134489 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134492 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134495 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134497 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134501 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134504 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134506 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134509 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134512 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.134539 2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134615 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134621 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134624 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.146459 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134627 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134630 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134632 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134635 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134638 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134642 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134644 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134647 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134650 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134652 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134655 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134658 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134660 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134663 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134666 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134668 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134671 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134674 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134676 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.147104 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134679 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134681 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134684 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134687 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134689 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134694 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134696 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134699 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134702 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134704 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134707 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134710 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134713 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134715 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134718 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134721 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134723 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134726 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134729 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134732 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.147900 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134735 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134737 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134740 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134742 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134745 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134748 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134750 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134753 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134755 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134758 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134760 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134763 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134766 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134769 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134773 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134777 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134780 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134784 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134787 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.148400 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134790 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134793 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134796 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134799 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134802 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134805 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134807 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134810 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134813 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134815 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134818 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134822 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134824 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134827 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134829 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134832 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134835 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134837 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134840 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134842 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.149069 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134845 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134847 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134850 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134852 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134855 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134858 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134860 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134863 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134866 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134868 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134872 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134875 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134878 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134894 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134897 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134900 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134903 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134906 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134908 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.149569 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134912 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134916 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134920 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134924 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134928 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.134931 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.143390 2584 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.143413 2584 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.143435 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.143443 2584 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143534 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143542 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143547 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143551 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143555 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143561 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143566 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143570 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143575 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.150085 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143579 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143583 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143588 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143592 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143596 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143601 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143605 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143610 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143614 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143618 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143622 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143626 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143631 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143635 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143639 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143644 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143649 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143653 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143658 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.150542 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143662 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143675 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143679 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143683 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143687 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143692 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143696 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143700 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143705 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143709 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143713 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143717 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143721 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143725 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143730 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143734 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143739 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143743 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143747 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143751 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.151081 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143756 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143760 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143764 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143768 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143772 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143777 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143781 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143785 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143790 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143795 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143799 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143803 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143808 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143812 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143826 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143831 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143835 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143839 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143843 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143847 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.151540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143854 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143860 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143865 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143869 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143873 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143877 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143898 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143905 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143911 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143915 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143919 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143923 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143928 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143932 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143936 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143940 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143944 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143948 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143953 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.152232 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143957 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143962 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143967 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143971 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143975 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143980 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143984 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.143989 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144001 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144006 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144010 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144014 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144019 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144023 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144027 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144031 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144036 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144040 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.152838 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144044 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.144086 2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144358 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144367 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144372 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144377 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144381 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144386 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144390 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144394 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144398 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144403 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144407 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144411 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144416 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144421 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.153394 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144426 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144430 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144435 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144439 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144443 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144447 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144451 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144463 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144468 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144473 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144477 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144481 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144486 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144490 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144494 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144498 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144504 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144510 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144516 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.153822 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144520 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144525 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144529 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144533 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144537 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144541 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144545 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144550 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144554 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144559 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144563 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144567 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144572 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144576 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144580 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144584 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144590 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144596 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144600 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.154563 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144605 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144610 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144621 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144626 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144630 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144635 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144639 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144643 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144648 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144652 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144656 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144661 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144665 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144669 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144673 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144678 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144682 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144686 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144690 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.155263 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144695 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144699 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144703 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144707 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144711 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144723 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144728 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144732 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144737 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144741 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144745 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144749 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144753 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144758 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144762 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144767 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144779 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144783 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144787 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144791 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.155795 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144795 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144800 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144804 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144808 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144813 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144817 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144821 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144826 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144830 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144834 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144838 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144842 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144847 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144851 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144855 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.144911 2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:27:32.156355 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144984 2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144991 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.144995 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145000 2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145005 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145009 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145013 2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145018 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145022 2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145026 2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145030 2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145034 2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145039 2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145051 2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145056 2584 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145060 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145065 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145069 2584 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145074 2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:27:32.156962 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145078 2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145082 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145086 2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145090 2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145094 2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145098 2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145103 2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145107 2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145111 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145115 2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145119 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145126 2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145132 2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145137 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145141 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145146 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145151 2584 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145156 2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145161 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:27:32.157420 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145165 2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145169 2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145173 2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145178 2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145182 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145186 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145190 2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145195 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145207 2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145211 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145215 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145221 2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145227 2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145231 2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145236 2584 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145241 2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145245 2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145250 2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145254 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:27:32.157870 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145259 2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145264 2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145268 2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145272 2584 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145276 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145281 2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145285 2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145289 2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145293 2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145297 2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145305 2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145309 2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145314 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145318 2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145322 2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145326 2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145330 2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145335 2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145339 2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:27:32.158326 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145343 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145347 2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145351 2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145363 2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145367 2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145372 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145376 2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145380 2584 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145384 2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145389 2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145393 2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145397 2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145402 2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145406 2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145410 2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145414 2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145419 2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145423 2584 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145427 2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145431 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:27:32.158828 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145436 2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145440 2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145444 2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145452 2584 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145456 2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145460 2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145465 2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145469 2584 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145473 2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:32.145478 2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.145572 2584 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.148700 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.149833 2584 server.go:1014] "Starting client certificate rotation" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.149933 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.149974 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.152532 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 07:27:32.159358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.156706 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 07:27:32.169788 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.169772 2584 log.go:25] "Validated CRI v1 runtime API" Oct 31 07:27:32.173795 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.173778 2584 log.go:25] "Validated CRI v1 image API" Oct 31 07:27:32.174671 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.174648 2584 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 07:27:32.180199 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.180174 2584 fs.go:135] Filesystem UUIDs: map[0f97840e-1f81-4af3-a9d5-58ae8ecc7902:/dev/nvme0n1p4 7013c8c1-0957-4f60-8f97-dc8660287aa9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 31 07:27:32.180258 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.180200 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 31 07:27:32.185801 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.185699 2584 manager.go:217] Machine: {Timestamp:2026-10-31 07:27:32.18425514 +0000 UTC m=+0.380049598 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105279 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ef6fb0d7ad2ae92bf09dec2078c2e SystemUUID:ec2ef6fb-0d7a-d2ae-92bf-09dec2078c2e BootID:834808fe-e09d-4a79-9743-457ec0ebb678 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cc:39:54:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cc:39:54:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:9d:5b:59:22:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 07:27:32.185900 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.185802 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 07:27:32.185900 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.185880 2584 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 07:27:32.189584 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189557 2584 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 07:27:32.189712 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189586 2584 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 07:27:32.189758 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189713 2584 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 07:27:32.189758 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189722 2584 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 07:27:32.189810 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189765 2584 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 07:27:32.189810 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.189783 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 07:27:32.191118 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.191108 2584 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 07:27:32.196010 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.195990 2584 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 07:27:32.196122 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.196112 2584 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 07:27:32.196968 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.196951 2584 kubelet.go:493] "Attempting to sync node with API server" Oct 31 07:27:32.197004 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.196973 2584 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 07:27:32.197004 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.196985 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 07:27:32.197004 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.196996 2584 kubelet.go:405] "Adding apiserver pod source" Oct 31 07:27:32.197111 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.197006 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 07:27:32.197366 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.197350 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 07:27:32.199835 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.199819 2584 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 07:27:32.209100 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.209083 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 07:27:32.210116 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210101 2584 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 07:27:32.210172 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210132 2584 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 07:27:32.210298 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210286 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 07:27:32.210335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210304 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 07:27:32.210335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210310 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 07:27:32.210335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210315 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 07:27:32.210335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210321 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 07:27:32.210335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210326 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 07:27:32.210970 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210961 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 07:27:32.210999 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210970 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 07:27:32.210999 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210977 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 07:27:32.210999 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210983 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 07:27:32.210999 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.210992 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 07:27:32.211150 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.211003 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 07:27:32.212370 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.212359 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 07:27:32.212405 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.212372 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 07:27:32.217038 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.217026 2584 server.go:1263] "Started kubelet" Oct 31 07:27:32.217237 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.217185 2584 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 07:27:32.217337 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.217183 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 07:27:32.217337 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.217278 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 07:27:32.217729 ip-10-0-136-217 systemd[1]: Started Kubernetes Kubelet. Oct 31 07:27:32.218762 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.218706 2584 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 07:27:32.219211 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.219195 2584 server.go:317] "Adding debug handlers to kubelet server" Oct 31 07:27:32.223956 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.223772 2584 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 31 07:27:32.228499 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.228480 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 07:27:32.229131 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229110 2584 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 07:27:32.229248 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.229200 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.229947 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229923 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 07:27:32.229947 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229935 2584 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 07:27:32.229947 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229944 2584 factory.go:55] Registering systemd factory Oct 31 07:27:32.230103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229953 2584 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 07:27:32.230103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229932 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 07:27:32.230103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.229955 2584 factory.go:223] Registration of the systemd container factory successfully Oct 31 07:27:32.230103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230040 2584 reconstruct.go:97] "Volume reconstruction finished" Oct 31 07:27:32.230103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230051 2584 reconciler.go:29] "Reconciler: start to sync state" Oct 31 07:27:32.230269 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230210 2584 factory.go:153] Registering CRI-O factory Oct 31 07:27:32.230269 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230223 2584 factory.go:223] Registration of the crio container factory successfully Oct 31 07:27:32.230269 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230240 2584 factory.go:103] Registering Raw factory Oct 31 07:27:32.230269 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.230257 2584 manager.go:1199] Started watching for new ooms in manager Oct 31 07:27:32.231384 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.231368 2584 manager.go:319] Starting recovery of all containers Oct 31 07:27:32.240222 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.240192 2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 07:27:32.240355 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.240336 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvpc4" Oct 31 07:27:32.240419 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.240358 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvpc4" Oct 31 07:27:32.241062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.241032 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 31 07:27:32.241822 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.240643 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-217.ec2.internal.18e38c95ef55ddbd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-217.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-217.ec2.internal,},FirstTimestamp:2026-10-31 07:27:32.216987069 +0000 UTC m=+0.412781527,LastTimestamp:2026-10-31 07:27:32.216987069 +0000 UTC m=+0.412781527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-217.ec2.internal,}" Oct 31 07:27:32.242719 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.242698 2584 manager.go:324] Recovery completed Oct 31 07:27:32.248661 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.247828 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.249650 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.249632 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.249722 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.249695 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.249722 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.249711 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.250275 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.250259 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.250275 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.250261 2584 cpu_manager.go:226] "Starting" policy="none" Oct 31 07:27:32.250367 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.250284 2584 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 07:27:32.250367 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.250300 2584 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 07:27:32.251699 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.251683 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.251791 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.251713 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.251791 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.251727 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.252414 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.252398 2584 policy_none.go:50] "Start" Oct 31 07:27:32.252414 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.252415 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 07:27:32.252526 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.252425 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 07:27:32.254487 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.254474 2584 policy_none.go:44] "Start" Oct 31 07:27:32.262118 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.262097 2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 31 07:27:32.262118 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.262099 2584 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 31 07:27:32.262373 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.262356 2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 31 07:27:32.279569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.279540 2584 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 07:27:32.285105 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285091 2584 manager.go:341] "Starting Device Plugin manager" Oct 31 07:27:32.285213 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.285121 2584 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 07:27:32.285213 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285130 2584 server.go:87] "Starting device plugin registration server" Oct 31 07:27:32.285386 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285373 2584 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 07:27:32.285427 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285389 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 07:27:32.285497 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285478 2584 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 07:27:32.285571 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285560 2584 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 07:27:32.285571 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.285571 2584 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 07:27:32.286176 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.286158 2584 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 07:27:32.286257 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.286208 2584 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.289130 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.289113 2584 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:32.364291 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.364257 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 07:27:32.366400 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.365500 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 07:27:32.366400 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.365525 2584 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 07:27:32.366400 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.365551 2584 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 07:27:32.366400 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.365590 2584 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 31 07:27:32.380163 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.380120 2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:32.386212 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.386197 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.387164 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.387148 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.387246 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.387177 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.387246 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.387188 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.387246 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.387212 2584 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.403975 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.403957 2584 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.404045 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.403978 2584 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-217.ec2.internal\": node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.440226 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.440207 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.466487 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.466333 2584 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal"] Oct 31 07:27:32.466558 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.466526 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.467416 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.467401 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.467499 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.467427 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.467499 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.467438 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.469700 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.469688 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.469896 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.469868 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.469945 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.469935 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.470456 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470438 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.470569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470464 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.470569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470474 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.470569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470440 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.470569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470547 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.470569 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.470562 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.472552 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.472534 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.472627 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.472564 2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:27:32.473374 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.473356 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:27:32.473442 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.473391 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:27:32.473442 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.473406 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:27:32.501440 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.501423 2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-217.ec2.internal\" not found" node="ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.504521 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.504505 2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-217.ec2.internal\" not found" node="ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.532265 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.532233 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.532374 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.532268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.532374 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.532288 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.541196 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.541178 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.632992 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.632972 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.633085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.632999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.633085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.633018 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.633085 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.633077 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.633178 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.633088 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.633178 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.633088 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.642097 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.642075 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.742585 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:32.742542 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:32.803753 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.803730 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:32.806893 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:32.806870 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:34.288953 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:34.288931 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:34.389562 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:34.389486 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:34.489989 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:34.489955 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:34.590543 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:34.590505 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:34.594672 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.594652 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 31 07:27:34.594792 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.594775 2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 07:27:34.594838 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.594817 2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 07:27:34.691382 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:34.691352 2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:27:34.693530 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.693492 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:22:33 +0000 UTC" deadline="2028-06-20 20:02:29.770694451 +0000 UTC" Oct 31 07:27:34.693530 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.693522 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14364h34m55.077175874s" Oct 31 07:27:34.715453 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.715431 2584 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:34.747819 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.747793 2584 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:34.775733 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.775709 2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:27:34.777200 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:34.777162 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f83b034c7f4b2860ef8c40782c16cd.slice/crio-23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9 WatchSource:0}: Error finding container 23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9: Status 404 returned error can't find the container with id 23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9 Oct 31 07:27:34.777560 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:34.777537 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3e4fbccff2ad1877ba003792ae09ae.slice/crio-3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47 WatchSource:0}: Error finding container 3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47: Status 404 returned error can't find the container with id 3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47 Oct 31 07:27:34.782962 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.782945 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:27:34.797600 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.797582 2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:27:34.798405 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.798392 2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:27:34.814741 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.814703 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerStarted","Data":"3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47"} Oct 31 07:27:34.815647 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.815617 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" event={"ID":"d3f83b034c7f4b2860ef8c40782c16cd","Type":"ContainerStarted","Data":"23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9"} Oct 31 07:27:34.818205 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:34.818192 2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:27:35.643584 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.643554 2584 apiserver.go:52] "Watching apiserver" Oct 31 07:27:35.675413 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.675385 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 31 07:27:35.684526 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.684500 2584 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 07:27:35.684841 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.684815 2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal","openshift-dns/node-resolver-ffhvf","openshift-network-diagnostics/network-check-target-2gtzn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5","openshift-cluster-node-tuning-operator/tuned-wjqj5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal","openshift-multus/network-metrics-daemon-gn94r","kube-system/global-pull-secret-syncer-tptr8","openshift-multus/multus-qgqtb","openshift-network-operator/iptables-alerter-86hqz","openshift-ovn-kubernetes/ovnkube-node-p9l6j","kube-system/konnectivity-agent-nlstp","openshift-image-registry/node-ca-d6ltq","openshift-multus/multus-additional-cni-plugins-cxnxp"] Oct 31 07:27:35.687497 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.687473 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.687604 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.687559 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:35.689721 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.689697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.692174 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.692072 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:35.692174 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.692139 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:35.694121 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.694068 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.696352 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.696333 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.698695 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.698669 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.700659 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.700642 2584 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:35.703595 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.703546 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.703988 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.703972 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 07:27:35.704103 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.704088 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.704184 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.704169 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.704224 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.704182 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hgtls\"" Oct 31 07:27:35.704358 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.704338 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.704449 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.704422 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:35.707439 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.707422 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.708222 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.708187 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 07:27:35.710489 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.710462 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.710741 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.710724 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n7m4f\"" Oct 31 07:27:35.710821 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.710781 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.710869 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.710836 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.712612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.711031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.712612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.711180 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.712612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.711215 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gjb5j\"" Oct 31 07:27:35.713045 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.713024 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.714242 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.714225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.716756 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.716739 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.777139 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.777116 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 07:27:35.787826 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.787779 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.787976 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.787833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.787976 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.787856 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.787976 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.787902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.787976 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.787955 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjvnc\" (UniqueName: \"kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788149 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788015 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.788149 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788047 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.788149 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788081 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788149 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788108 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788158 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788191 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788288 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788348 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzvd\" (UniqueName: \"kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788467 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788522 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfkrq\" (UniqueName: \"kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.788612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788562 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788610 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4vq\" (UniqueName: \"kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788732 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.788839 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788840 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788869 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788941 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpxg\" (UniqueName: \"kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788974 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.788991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789024 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qk5\" (UniqueName: \"kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789107 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789146 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnj8c\" (UniqueName: \"kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789295 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789364 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789338 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789379 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n2lc\" (UniqueName: \"kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789433 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789479 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789532 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789649 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789655 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789715 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789745 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789760 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789776 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789794 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbhz\" (UniqueName: \"kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789901 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.789940 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789932 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789949 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.789982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790070 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790102 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790158 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790190 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790229 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790282 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790320 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790389 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.790404 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790451 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790479 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790531 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.790921 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.790564 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.805902 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.805873 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.806314 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.806294 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.806444 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.806363 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 07:27:35.806512 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.806487 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.806577 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.806561 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vgg5g\"" Oct 31 07:27:35.807160 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807142 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fh9bq\"" Oct 31 07:27:35.807282 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807178 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 07:27:35.807356 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807336 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 07:27:35.807432 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807415 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xhs6v\"" Oct 31 07:27:35.807546 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807479 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.807546 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807524 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtmc6\"" Oct 31 07:27:35.807656 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807585 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 07:27:35.807715 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807683 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6ssn\"" Oct 31 07:27:35.807803 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807789 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 07:27:35.807883 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807865 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.807980 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807916 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 07:27:35.807980 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.807967 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 07:27:35.808115 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.808093 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 07:27:35.808182 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.808155 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 07:27:35.808231 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.808195 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 07:27:35.818427 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818405 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 07:27:35.818527 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818480 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 07:27:35.818591 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818547 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 07:27:35.818648 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818605 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7l5b\"" Oct 31 07:27:35.818716 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818696 2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 07:27:35.818841 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.818767 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nvwlr" Oct 31 07:27:35.891797 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891759 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.891797 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891865 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891908 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891937 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891911 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.891990 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892015 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.892062 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892074 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.892039 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892137 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.892204 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:36.392160633 +0000 UTC m=+3.142589457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892232 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892264 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892285 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbhz\" (UniqueName: \"kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892340 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892365 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892395 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892395 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.892540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892415 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892429 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892447 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892464 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892501 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892514 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892526 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892547 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892569 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892571 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892603 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892605 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892653 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892653 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892690 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.893333 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892737 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892736 2584 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892755 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892763 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892771 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892789 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892822 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892827 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892848 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892897 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892938 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892941 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892967 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.894215 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892984 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.892998 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvnc\" (UniqueName: \"kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893023 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893024 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893115 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893172 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893217 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893218 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893222 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893233 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893239 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893297 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895080 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893309 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893341 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893345 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzvd\" (UniqueName: \"kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893369 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893395 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893401 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893451 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkrq\" (UniqueName: \"kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893476 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893502 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893539 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4vq\" (UniqueName: \"kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893601 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.895881 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893605 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893646 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893653 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893669 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893711 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893716 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpxg\" (UniqueName: \"kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893740 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893740 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893763 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893791 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893814 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qk5\" (UniqueName: \"kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893828 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893866 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnj8c\" (UniqueName: \"kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893867 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.896607 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893939 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893984 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893997 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n2lc\" (UniqueName: \"kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894235 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894321 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893141 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894384 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894448 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894476 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894489 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894528 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.894564 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894566 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897206 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893670 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.894645 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:27:36.394633285 +0000 UTC m=+3.145062092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894723 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894873 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894942 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894954 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.894974 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895000 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895016 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.893984 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895062 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895151 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895186 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895312 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895384 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895413 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.897866 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895759 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.898628 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.895807 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.898628 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.896139 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.898628 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.896666 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.899423 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.899399 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:35.899665 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.899639 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.901192 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.901167 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.931993 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.931961 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:35.932128 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.932028 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:35.932128 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.932052 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:35.932228 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:35.932152 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:27:36.432113198 +0000 UTC m=+3.182542021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:35.934094 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.934006 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzvd\" (UniqueName: \"kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:35.934513 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.934487 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qk5\" (UniqueName: \"kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:35.935763 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.935729 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpxg\" (UniqueName: \"kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:35.936463 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.936406 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4vq\" (UniqueName: \"kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:35.936463 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.936406 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnj8c\" (UniqueName: \"kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:27:35.936613 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.936551 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvnc\" (UniqueName: \"kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:35.936613 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.936592 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n2lc\" (UniqueName: \"kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:35.937117 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.937074 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkrq\" (UniqueName: \"kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:35.938852 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:35.938835 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbhz\" (UniqueName: \"kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:36.004011 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.003989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:27:36.014445 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.014417 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc115d685_21cd_4266_b6ee_49277e579096.slice/crio-90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef WatchSource:0}: Error finding container 90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef: Status 404 returned error can't find the container with id 90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef Oct 31 07:27:36.018046 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.018027 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:27:36.021989 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.021966 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:27:36.031680 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.031647 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:27:36.045201 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.045174 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8697ef31_6a1d_4d75_a5a8_2d715991cfef.slice/crio-dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0 WatchSource:0}: Error finding container dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0: Status 404 returned error can't find the container with id dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0 Oct 31 07:27:36.051740 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.051716 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qgqtb" Oct 31 07:27:36.054117 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.054075 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:27:36.056572 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.056534 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:27:36.062779 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.062752 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20df0d97_58e7_42de_a1c0_e195bc62abca.slice/crio-cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db WatchSource:0}: Error finding container cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db: Status 404 returned error can't find the container with id cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db Oct 31 07:27:36.067320 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.067296 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a7b750_341e_40b7_a425_5a452187e803.slice/crio-74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd WatchSource:0}: Error finding container 74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd: Status 404 returned error can't find the container with id 74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd Oct 31 07:27:36.070320 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.069297 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcca29ae_118f_4d8e_9dca_47c6f152f234.slice/crio-9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9 WatchSource:0}: Error finding container 9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9: Status 404 returned error can't find the container with id 9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9 Oct 31 07:27:36.073314 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.073296 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:36.079741 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.079722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:36.083540 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.083507 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77a849d_a548_4916_9c49_ca1aa09594e8.slice/crio-3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d WatchSource:0}: Error finding container 3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d: Status 404 returned error can't find the container with id 3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d Oct 31 07:27:36.089465 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:27:36.089437 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9374723a_d550_4425_9fb9_380fd3784945.slice/crio-b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6 WatchSource:0}: Error finding container b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6: Status 404 returned error can't find the container with id b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6 Oct 31 07:27:36.197372 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.197302 2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:27:36.397723 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.397685 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:36.397892 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.397849 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:36.397892 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.397869 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:36.398000 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.397917 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:27:37.397898936 +0000 UTC m=+4.148327757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:36.398000 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.397979 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:36.398107 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.398024 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:37.398012969 +0000 UTC m=+4.148441792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:36.499500 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.498758 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:36.499500 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.498938 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:36.499500 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.498957 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:36.499500 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.498969 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:36.499500 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.499026 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:27:37.499008943 +0000 UTC m=+4.249437752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:36.812024 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.811936 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:36.812840 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:36.812073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:36.822024 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.821911 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:35 +0000 UTC" deadline="2028-08-17 10:48:42.25711497 +0000 UTC" Oct 31 07:27:36.822024 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.821963 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15747h21m5.435156186s" Oct 31 07:27:36.829344 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.829240 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffhvf" event={"ID":"fcca29ae-118f-4d8e-9dca-47c6f152f234","Type":"ContainerStarted","Data":"9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9"} Oct 31 07:27:36.849852 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.849818 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerStarted","Data":"74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd"} Oct 31 07:27:36.873994 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.873944 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qgqtb" event={"ID":"20df0d97-58e7-42de-a1c0-e195bc62abca","Type":"ContainerStarted","Data":"cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db"} Oct 31 07:27:36.881301 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.881272 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86hqz" event={"ID":"8697ef31-6a1d-4d75-a5a8-2d715991cfef","Type":"ContainerStarted","Data":"dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0"} Oct 31 07:27:36.901498 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.901467 2584 generic.go:356] "Generic (PLEG): container finished" podID="2c3e4fbccff2ad1877ba003792ae09ae" containerID="4cfa0fa4eb2d3f43b2e887ea51406472ce7b35562cae4d0484b12f0dc1376712" exitCode=0 Oct 31 07:27:36.901620 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.901555 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerDied","Data":"4cfa0fa4eb2d3f43b2e887ea51406472ce7b35562cae4d0484b12f0dc1376712"} Oct 31 07:27:36.912473 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.912036 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6"} Oct 31 07:27:36.926156 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.926126 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlstp" event={"ID":"a77a849d-a548-4916-9c49-ca1aa09594e8","Type":"ContainerStarted","Data":"3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d"} Oct 31 07:27:36.942102 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.942069 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" event={"ID":"5c2a96ac-7c93-474c-a4ad-9b0091d95209","Type":"ContainerStarted","Data":"768c5e3ead470ea4a5da8b9c540b755a1879ba7b0f9ca56c4306eec284dddecd"} Oct 31 07:27:36.963432 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.963202 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" event={"ID":"5312dbea-fea7-4156-9f54-594964546777","Type":"ContainerStarted","Data":"60267fcaae875f87d626558f173468b180d3b37e63d4224c0c48fe8b7a3b5a9b"} Oct 31 07:27:36.975624 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:36.975593 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6ltq" event={"ID":"c115d685-21cd-4266-b6ee-49277e579096","Type":"ContainerStarted","Data":"90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef"} Oct 31 07:27:37.006821 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.006766 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" event={"ID":"d3f83b034c7f4b2860ef8c40782c16cd","Type":"ContainerStarted","Data":"9114206877fcc1fb2601862bac1826c09d90d25e8fb76ab0e3367b86f0a57bb7"} Oct 31 07:27:37.043025 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.042961 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" podStartSLOduration=3.042940671 podStartE2EDuration="3.042940671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:37.042615634 +0000 UTC m=+3.793044461" watchObservedRunningTime="2026-10-31 07:27:37.042940671 +0000 UTC m=+3.793369497" Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.408064 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.408142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.408305 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.408370 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:27:39.408349831 +0000 UTC m=+6.158778649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.408759 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:37.408891 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.408807 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:39.408792455 +0000 UTC m=+6.159221263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:37.509169 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.508952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:37.509169 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.509165 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:37.509388 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.509186 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:37.509388 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.509200 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:37.509388 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.509307 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:27:39.509237994 +0000 UTC m=+6.259666804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:37.812137 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.811355 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:37.812137 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.811493 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:37.812137 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.811915 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:37.812137 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:37.812015 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:37.822877 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.822791 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:35 +0000 UTC" deadline="2028-08-16 01:39:55.42726066 +0000 UTC" Oct 31 07:27:37.822877 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:37.822849 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15714h12m17.604415589s" Oct 31 07:27:38.028406 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:38.028339 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerStarted","Data":"74a4af2a0599fa3f2463c548e13d0211686313761701fcd0cadc4060a5f1395a"} Oct 31 07:27:38.811399 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:38.811356 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:38.811547 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:38.811505 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:39.047130 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.047054 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="1cb690b9204e22d3fa96e79022a3216a74e124e35ae67db5b15605160bc30d0b" exitCode=0 Oct 31 07:27:39.048535 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.048155 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"1cb690b9204e22d3fa96e79022a3216a74e124e35ae67db5b15605160bc30d0b"} Oct 31 07:27:39.114473 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.114412 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" podStartSLOduration=5.114396167 podStartE2EDuration="5.114396167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:38.070895714 +0000 UTC m=+4.821324539" watchObservedRunningTime="2026-10-31 07:27:39.114396167 +0000 UTC m=+5.864824993" Oct 31 07:27:39.425797 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.425760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:39.425968 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.425840 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:39.425968 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.425957 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:39.426094 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.426024 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:43.426005318 +0000 UTC m=+10.176434127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:39.426174 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.426100 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:39.426174 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.426133 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:27:43.426121945 +0000 UTC m=+10.176550754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:39.526469 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.526434 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:39.526696 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.526666 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:39.526696 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.526692 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:39.526809 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.526706 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:39.526809 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.526764 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:27:43.526746725 +0000 UTC m=+10.277175532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:39.813442 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.813416 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:39.813580 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.813539 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:39.813580 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:39.813426 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:39.813688 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:39.813654 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:40.074190 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:40.074088 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlstp" event={"ID":"a77a849d-a548-4916-9c49-ca1aa09594e8","Type":"ContainerStarted","Data":"10ae5f724936c3d8294e9203c56e11826c3f8ebc8ab7331b7b10559df1f5b352"} Oct 31 07:27:40.737185 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:40.737150 2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:40.737903 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:40.737881 2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:40.775639 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:40.775262 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nlstp" podStartSLOduration=4.051803994 podStartE2EDuration="7.775229104s" totalImagesPullingTime="3.72342511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:40.117550276 +0000 UTC m=+6.867979103" watchObservedRunningTime="2026-10-31 07:27:40.775229104 +0000 UTC m=+7.525657930" Oct 31 07:27:40.811156 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:40.811125 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:40.811302 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:40.811276 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:41.083762 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:41.083676 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6ltq" event={"ID":"c115d685-21cd-4266-b6ee-49277e579096","Type":"ContainerStarted","Data":"62f1e3e365e079f3e9e8d8aa1705a9d00afa7751eb343f30a87a221b4666c2bc"} Oct 31 07:27:41.813442 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:41.813417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:41.813442 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:41.813437 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:41.813605 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:41.813545 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:41.813605 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:41.813643 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:42.089036 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:42.088560 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" event={"ID":"5312dbea-fea7-4156-9f54-594964546777","Type":"ContainerStarted","Data":"12548fc0995773d983c12e84e81a3f0d6a8597b0e747b899c1f3ff260a47efbc"} Oct 31 07:27:42.089036 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:42.088665 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:27:42.811886 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:42.811435 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:42.811886 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:42.811571 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:43.300681 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.300655 2584 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 07:27:43.458455 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.458427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:43.458540 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.458498 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:43.458604 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.458592 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:43.458643 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.458639 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:51.458626815 +0000 UTC m=+18.209055631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:43.458683 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.458679 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:43.458714 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.458699 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:27:51.458691945 +0000 UTC m=+18.209120762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:43.560526 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.559768 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:43.560526 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.559951 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:43.560526 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.559976 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:43.560526 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.559991 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:43.560526 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.560049 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:27:51.560031296 +0000 UTC m=+18.310460104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:43.736323 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.736209 2584 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:27:43.300679023Z","UUID":"f9d75c01-bc2f-49e6-a73a-8bba01d17584","Handler":null,"Name":"","Endpoint":""} Oct 31 07:27:43.743961 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.743936 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 07:27:43.744071 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.743979 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 07:27:43.813351 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.812961 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:43.813351 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:43.813030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:43.813351 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.813100 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:43.813351 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:43.813243 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:44.097565 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.097493 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" event={"ID":"5312dbea-fea7-4156-9f54-594964546777","Type":"ContainerStarted","Data":"e3429acc486d5c46f3b08441f3fd336835cf13b793e7841aa0914f9d5163577a"} Oct 31 07:27:44.099935 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.099403 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffhvf" event={"ID":"fcca29ae-118f-4d8e-9dca-47c6f152f234","Type":"ContainerStarted","Data":"09f567502cd545ed91ae23bd55a21cc94914e8bc03fc37a3202f5a340e6e0497"} Oct 31 07:27:44.102332 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.102306 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="4b2f8d5579a5c577dba8f8d6f1fc881ff890784520096619aecd0d0ec559c807" exitCode=0 Oct 31 07:27:44.102418 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.102372 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"4b2f8d5579a5c577dba8f8d6f1fc881ff890784520096619aecd0d0ec559c807"} Oct 31 07:27:44.106758 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.106738 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qgqtb" event={"ID":"20df0d97-58e7-42de-a1c0-e195bc62abca","Type":"ContainerStarted","Data":"55c39b9e16a1b9451ef62c36b3d3b0e7160d3f30fcd66c03229ca120b47bb350"} Oct 31 07:27:44.138395 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.138339 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6ltq" podStartSLOduration=6.383078238 podStartE2EDuration="11.138322428s" totalImagesPullingTime="4.75524419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:41.121059845 +0000 UTC m=+7.871488685" watchObservedRunningTime="2026-10-31 07:27:44.138322428 +0000 UTC m=+10.888751256" Oct 31 07:27:44.177638 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.177588 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-ffhvf" podStartSLOduration=3.343181493 podStartE2EDuration="11.1775712s" totalImagesPullingTime="7.834389707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:44.139221818 +0000 UTC m=+10.889650641" watchObservedRunningTime="2026-10-31 07:27:44.1775712 +0000 UTC m=+10.928000025" Oct 31 07:27:44.222699 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.222642 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-qgqtb" podStartSLOduration=3.859548607 podStartE2EDuration="11.222628289s" totalImagesPullingTime="7.363079682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:44.178143897 +0000 UTC m=+10.928572723" watchObservedRunningTime="2026-10-31 07:27:44.222628289 +0000 UTC m=+10.973057113" Oct 31 07:27:44.811837 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:44.811655 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:44.812201 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:44.811913 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:45.112588 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.112549 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" event={"ID":"5312dbea-fea7-4156-9f54-594964546777","Type":"ContainerStarted","Data":"68443a49a58258a5f33b58e21817ea6a5a8d1318a75313c1730a8213a1d3f089"} Oct 31 07:27:45.115082 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.115038 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="92af5c0572523aecd99b463f89039621f1ac42f86b6840a09a0470239b3e1f7e" exitCode=0 Oct 31 07:27:45.115197 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.115107 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"92af5c0572523aecd99b463f89039621f1ac42f86b6840a09a0470239b3e1f7e"} Oct 31 07:27:45.117900 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.117117 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86hqz" event={"ID":"8697ef31-6a1d-4d75-a5a8-2d715991cfef","Type":"ContainerStarted","Data":"e3cbec7d5a0d2f718df40f6c7350d543764efbe04b37b7814f16f5aa07ad1806"} Oct 31 07:27:45.151777 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.151720 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" podStartSLOduration=4.250905564 podStartE2EDuration="12.151702499s" totalImagesPullingTime="7.900796935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:45.151341523 +0000 UTC m=+11.901770352" watchObservedRunningTime="2026-10-31 07:27:45.151702499 +0000 UTC m=+11.902131324" Oct 31 07:27:45.228796 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.228743 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-86hqz" podStartSLOduration=4.847685694 podStartE2EDuration="12.228727103s" totalImagesPullingTime="7.381041409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:45.228463391 +0000 UTC m=+11.978892220" watchObservedRunningTime="2026-10-31 07:27:45.228727103 +0000 UTC m=+11.979155927" Oct 31 07:27:45.811943 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.811910 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:45.811943 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:45.811943 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:45.812463 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:45.812031 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:45.812463 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:45.812159 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:46.120745 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:46.120684 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" event={"ID":"5c2a96ac-7c93-474c-a4ad-9b0091d95209","Type":"ContainerStarted","Data":"f75e01522a482b9f7dc89cb797f307e8118e7ac66448dfa831327ff0b690aeec"} Oct 31 07:27:46.159612 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:46.159572 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" podStartSLOduration=3.374195027 podStartE2EDuration="13.159559187s" totalImagesPullingTime="9.78536416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:46.159511422 +0000 UTC m=+12.909940248" watchObservedRunningTime="2026-10-31 07:27:46.159559187 +0000 UTC m=+12.909988012" Oct 31 07:27:46.811513 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:46.811468 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:46.811695 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:46.811597 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:47.134815 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:47.134776 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="79fc7c336df8fc2adcbc83556b8a3658f02f2ecac620d773539b789c56120c83" exitCode=0 Oct 31 07:27:47.135502 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:47.134898 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"79fc7c336df8fc2adcbc83556b8a3658f02f2ecac620d773539b789c56120c83"} Oct 31 07:27:47.811963 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:47.811930 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:47.811963 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:47.811968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:47.812194 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:47.812059 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:47.812724 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:47.812686 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:48.811301 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:48.811269 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:48.812083 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:48.811394 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:49.142529 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.142341 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="c3bcbbde3d833b23c875ca1c3d1c4445d1d207cf6c04a3641bc67f01dcfee8b7" exitCode=0 Oct 31 07:27:49.142705 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.142413 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"c3bcbbde3d833b23c875ca1c3d1c4445d1d207cf6c04a3641bc67f01dcfee8b7"} Oct 31 07:27:49.738521 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.738482 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:49.738703 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.738634 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:27:49.739227 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.739208 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:27:49.811317 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.811289 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:49.811691 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:49.811327 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:49.811691 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:49.811399 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:49.811691 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:49.811509 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:50.147657 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:50.147627 2584 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="8e25f8288ecb06bdfb276785a0d469b9335da360f0705dcc8322d593c972e0ce" exitCode=0 Oct 31 07:27:50.147791 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:50.147717 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerDied","Data":"8e25f8288ecb06bdfb276785a0d469b9335da360f0705dcc8322d593c972e0ce"} Oct 31 07:27:50.811931 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:50.811720 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:50.812334 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:50.811955 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:51.155265 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.155218 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" event={"ID":"12a7b750-341e-40b7-a425-5a452187e803","Type":"ContainerStarted","Data":"3e36873867fc06c07a2886559c4268e58f7e2168002e6a68a3f50fedc7e49db9"} Oct 31 07:27:51.158221 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158198 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"bc5750156ae4bc7bc3bf8af437d69d1e0d485ae24cf1d950cb01d40d79f46c2a"} Oct 31 07:27:51.158350 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158271 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"2b3652fb2135f5e6cf2deaf8520cb2efb65f1a58412648913d443bc949ff0dca"} Oct 31 07:27:51.158350 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158303 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"d0f8b528b8acf5b2eca0fe09e02b5f4bcff23f05d61b17893297b5a0ed1a027d"} Oct 31 07:27:51.158350 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158332 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"56b6b02ea3ab4879d82cadccdb8f066d441cca259273c075c4c68f4889c24095"} Oct 31 07:27:51.158439 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158360 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"85eca3c271119ff6612c5a8f1ffc80d78ec199dd506a1d5b3259425407c5aa47"} Oct 31 07:27:51.158439 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.158387 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"7e8b23dbad5f8ac77e57e151eb2a9df01c7f6d753c5c8f75fd88b5659913eb63"} Oct 31 07:27:51.220604 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.220551 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxnxp" podStartSLOduration=8.134900791 podStartE2EDuration="18.220537205s" totalImagesPullingTime="10.085636414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:51.207550329 +0000 UTC m=+17.957979154" watchObservedRunningTime="2026-10-31 07:27:51.220537205 +0000 UTC m=+17.970966029" Oct 31 07:27:51.527311 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.527222 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:51.527311 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.527277 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:51.527486 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.527351 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:51.527486 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.527351 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:51.527486 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.527397 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret podName:612b66f6-ebbd-40d4-87a9-3ced431e0a0f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.527383334 +0000 UTC m=+34.277812137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret") pod "global-pull-secret-syncer-tptr8" (UID: "612b66f6-ebbd-40d4-87a9-3ced431e0a0f") : object "kube-system"/"original-pull-secret" not registered Oct 31 07:27:51.527486 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.527409 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs podName:a3001ced-ad94-48ad-b282-06a2a531606c nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.527403535 +0000 UTC m=+34.277832338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs") pod "network-metrics-daemon-gn94r" (UID: "a3001ced-ad94-48ad-b282-06a2a531606c") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 07:27:51.627870 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.627841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:51.627999 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.627967 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 07:27:51.627999 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.627985 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 07:27:51.627999 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.627994 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5h9xq for pod openshift-network-diagnostics/network-check-target-2gtzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:51.628096 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.628034 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq podName:21a6f12f-fda5-4424-9e56-6a0ca7387aaf nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.628023102 +0000 UTC m=+34.378451906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5h9xq" (UniqueName: "kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq") pod "network-check-target-2gtzn" (UID: "21a6f12f-fda5-4424-9e56-6a0ca7387aaf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 07:27:51.811217 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.811139 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:51.811217 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:51.811158 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:51.811428 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.811292 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:51.811428 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:51.811391 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:52.811899 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:52.811812 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:52.812289 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:52.811925 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:53.164645 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:53.164614 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"53e52a2c1eba8470171c12f9182d5f518c22b672ee382a730a951e738d7285ce"} Oct 31 07:27:53.812626 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:53.812589 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:53.813138 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:53.812673 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:53.813138 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:53.812770 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:53.813138 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:53.812888 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:54.812017 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:54.811971 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:54.812176 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:54.812109 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:55.171944 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.171907 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" event={"ID":"9374723a-d550-4425-9fb9-380fd3784945","Type":"ContainerStarted","Data":"fad904b3cc31f57a1608c12bfc4c05ed4987180da851a5ba3d354b041cdc15fd"} Oct 31 07:27:55.172760 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.172170 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:55.187896 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.187872 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:55.253513 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.253469 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" podStartSLOduration=8.194003857 podStartE2EDuration="22.253457197s" totalImagesPullingTime="14.05945334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:55.24028195 +0000 UTC m=+21.990710775" watchObservedRunningTime="2026-10-31 07:27:55.253457197 +0000 UTC m=+22.003886023" Oct 31 07:27:55.811279 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.811229 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:55.811492 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:55.811241 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:55.811492 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:55.811384 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:55.811492 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:55.811444 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:56.174087 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.174059 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:27:56.174487 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.174456 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:56.188849 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.188828 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:27:56.662455 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.662212 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tptr8"] Oct 31 07:27:56.662615 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.662571 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:56.662615 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.662588 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2gtzn"] Oct 31 07:27:56.662733 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:56.662687 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:56.662797 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.662774 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:56.662907 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:56.662883 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:56.663429 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.663404 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn94r"] Oct 31 07:27:56.663536 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:56.663491 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:56.663606 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:56.663581 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:57.176611 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:57.176583 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:27:57.811950 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:57.811921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:57.812184 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:57.812029 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:27:58.179106 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:58.179075 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:27:58.811981 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:58.811946 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:27:58.811981 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:58.811972 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:27:58.812182 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:58.812051 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:27:58.812182 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:58.812127 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:27:59.811835 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:27:59.811802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:27:59.812212 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:27:59.811909 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:28:00.811790 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:00.811762 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:00.811942 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:00.811762 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:00.811942 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:28:00.811863 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:28:00.811942 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:28:00.811932 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:28:01.812043 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:01.812009 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:01.812490 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:28:01.812148 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn94r" podUID="a3001ced-ad94-48ad-b282-06a2a531606c" Oct 31 07:28:02.811177 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:02.811149 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:02.811177 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:02.811176 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:02.811328 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:28:02.811290 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gtzn" podUID="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" Oct 31 07:28:02.811368 ip-10-0-136-217 kubenswrapper[2584]: E1031 07:28:02.811325 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tptr8" podUID="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" Oct 31 07:28:03.072985 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:03.072919 2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeReady" Oct 31 07:28:03.073355 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:03.073054 2584 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 31 07:28:03.812739 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:03.812708 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:03.828927 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:03.828908 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 07:28:03.829072 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:03.829061 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nzlr\"" Oct 31 07:28:04.394719 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.394695 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffhvf_fcca29ae-118f-4d8e-9dca-47c6f152f234/dns-node-resolver/0.log" Oct 31 07:28:04.533160 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.533125 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:04.533377 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.533362 2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:28:04.545335 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.545311 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:04.811527 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.811447 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:04.811527 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.811455 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:04.829214 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.829196 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 07:28:04.829432 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.829414 2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 07:28:04.829487 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.829451 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qk9pc\"" Oct 31 07:28:04.829517 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.829488 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 07:28:04.829517 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:04.829498 2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-548vl\"" Oct 31 07:28:05.521519 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:05.521481 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlstp_a77a849d-a548-4916-9c49-ca1aa09594e8/konnectivity-agent/0.log" limit=1024 Oct 31 07:28:05.545145 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:05.545049 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6ltq_c115d685-21cd-4266-b6ee-49277e579096/node-ca/0.log" Oct 31 07:28:05.768970 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:05.768937 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlstp_a77a849d-a548-4916-9c49-ca1aa09594e8/konnectivity-agent/0.log" limit=1024 Oct 31 07:28:05.902372 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:05.902340 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlstp_a77a849d-a548-4916-9c49-ca1aa09594e8/konnectivity-agent/0.log" limit=1024 Oct 31 07:28:06.112583 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:06.112551 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlstp_a77a849d-a548-4916-9c49-ca1aa09594e8/konnectivity-agent/0.log" limit=1024 Oct 31 07:28:07.545712 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.545673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:07.546106 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.545730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:07.549216 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.549190 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:07.549338 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.549189 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:07.565145 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.565122 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:07.646336 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.646309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:07.648885 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.648860 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:07.784724 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.784695 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:07.879217 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:07.879187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:08.003632 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.003601 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tptr8"] Oct 31 07:28:08.008393 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:28:08.008365 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612b66f6_ebbd_40d4_87a9_3ced431e0a0f.slice/crio-b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70 WatchSource:0}: Error finding container b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70: Status 404 returned error can't find the container with id b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70 Oct 31 07:28:08.085966 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.085925 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn94r"] Oct 31 07:28:08.090004 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:28:08.089976 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3001ced_ad94_48ad_b282_06a2a531606c.slice/crio-e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224 WatchSource:0}: Error finding container e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224: Status 404 returned error can't find the container with id e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224 Oct 31 07:28:08.176707 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.176669 2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2gtzn"] Oct 31 07:28:08.180670 ip-10-0-136-217 kubenswrapper[2584]: W1031 07:28:08.180648 2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a6f12f_fda5_4424_9e56_6a0ca7387aaf.slice/crio-da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989 WatchSource:0}: Error finding container da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989: Status 404 returned error can't find the container with id da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989 Oct 31 07:28:08.200826 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.200798 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2gtzn" event={"ID":"21a6f12f-fda5-4424-9e56-6a0ca7387aaf","Type":"ContainerStarted","Data":"da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989"} Oct 31 07:28:08.201919 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.201890 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tptr8" event={"ID":"612b66f6-ebbd-40d4-87a9-3ced431e0a0f","Type":"ContainerStarted","Data":"b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70"} Oct 31 07:28:08.202959 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:08.202938 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn94r" event={"ID":"a3001ced-ad94-48ad-b282-06a2a531606c","Type":"ContainerStarted","Data":"e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224"} Oct 31 07:28:10.211243 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:10.211199 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn94r" event={"ID":"a3001ced-ad94-48ad-b282-06a2a531606c","Type":"ContainerStarted","Data":"4e2ef526895d8bd5a617bc8d67d72502206515ded2357caf8183164104f2a6b2"} Oct 31 07:28:10.211713 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:10.211273 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn94r" event={"ID":"a3001ced-ad94-48ad-b282-06a2a531606c","Type":"ContainerStarted","Data":"b189cb41eca5e9bc44da1d7da6d41ad23f60cf0d1090ef673cf4baff067ea028"} Oct 31 07:28:10.253937 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:10.253876 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gn94r" podStartSLOduration=35.920272063 podStartE2EDuration="37.253857397s" totalImagesPullingTime="1.333585334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:10.253045924 +0000 UTC m=+37.003474751" watchObservedRunningTime="2026-10-31 07:28:10.253857397 +0000 UTC m=+37.004286223" Oct 31 07:28:12.218681 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:12.218596 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2gtzn" event={"ID":"21a6f12f-fda5-4424-9e56-6a0ca7387aaf","Type":"ContainerStarted","Data":"7fd44a98e791a9478b8d348958afc1ed0c65f118ba3e68e6fa2c53259796c562"} Oct 31 07:28:12.219056 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:12.218715 2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:13.222922 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:13.222887 2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tptr8" event={"ID":"612b66f6-ebbd-40d4-87a9-3ced431e0a0f","Type":"ContainerStarted","Data":"52fbba58bbed09062df3c5f1bc8b4306b8402121391e51a6aef8ce3dfd698395"} Oct 31 07:28:13.259906 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:13.259817 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2gtzn" podStartSLOduration=36.556459938 podStartE2EDuration="40.25980261s" totalImagesPullingTime="3.703342672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:12.257407755 +0000 UTC m=+39.007836580" watchObservedRunningTime="2026-10-31 07:28:13.25980261 +0000 UTC m=+40.010231460" Oct 31 07:28:13.260069 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:13.260051 2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tptr8" podStartSLOduration=35.28332211 podStartE2EDuration="40.260046802s" totalImagesPullingTime="4.976724692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:13.259936514 +0000 UTC m=+40.010365329" watchObservedRunningTime="2026-10-31 07:28:13.260046802 +0000 UTC m=+40.010475627" Oct 31 07:28:13.279474 ip-10-0-136-217 kubenswrapper[2584]: I1031 07:28:13.279342 2584 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 07:28:13.279513 ip-10-0-136-217 systemd[1]: Stopping Kubernetes Kubelet... Oct 31 07:28:13.292694 ip-10-0-136-217 systemd[1]: kubelet.service: Deactivated successfully. Oct 31 07:28:13.292860 ip-10-0-136-217 systemd[1]: Stopped Kubernetes Kubelet. Oct 31 07:28:13.292910 ip-10-0-136-217 systemd[1]: kubelet.service: Consumed 2.112s CPU time. Oct 31 07:28:13.304714 ip-10-0-136-217 systemd[1]: Starting Kubernetes Kubelet... Oct 31 07:28:13.396466 ip-10-0-136-217 kubenswrapper[4406]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:28:13.396466 ip-10-0-136-217 kubenswrapper[4406]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 07:28:13.396466 ip-10-0-136-217 kubenswrapper[4406]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:28:13.396466 ip-10-0-136-217 kubenswrapper[4406]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 07:28:13.398482 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398406 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.398482 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398482 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.398482 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398485 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398489 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398493 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398496 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398499 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398502 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398505 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398508 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398511 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398514 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398516 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398519 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398521 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398524 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398528 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398533 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398536 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398539 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398541 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.398585 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398544 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398547 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398550 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398552 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398555 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398561 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398564 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398567 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398569 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398572 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398574 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398577 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398579 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398582 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398585 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398588 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398591 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398594 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398597 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398599 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.399061 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398602 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398605 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398607 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398610 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398612 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398614 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398617 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398619 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398622 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398624 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398627 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398630 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398633 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398635 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398638 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398640 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398643 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398646 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398649 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.399577 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398652 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398657 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398659 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398662 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398665 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398667 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398670 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398672 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398675 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398677 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398680 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398682 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398685 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398687 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398690 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398692 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398695 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398698 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398700 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398703 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.400048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398706 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398708 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398711 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398714 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398716 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398718 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398721 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398723 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398726 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398730 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398732 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398734 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398737 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398740 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398743 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398746 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398751 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398755 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398758 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398760 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.400548 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398763 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398766 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398768 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398771 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398773 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.398776 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399535 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399543 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399547 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399550 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399553 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399556 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399558 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399561 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399564 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399566 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399569 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399572 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399574 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399577 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.401025 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399580 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399583 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399586 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399588 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399603 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399610 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399613 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399617 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399620 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399622 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399625 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399628 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399630 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399633 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399636 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399638 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399641 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399643 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399646 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399648 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.401563 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399651 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399654 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399656 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399659 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399662 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399664 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399667 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399669 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399672 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399675 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399677 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399680 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399683 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399687 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399690 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399693 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399696 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399699 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399702 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399704 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.402069 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399707 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399709 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399712 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399714 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399718 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399720 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399723 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399725 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399728 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399730 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399733 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399735 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399738 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399740 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399750 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399753 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399756 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399758 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399761 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.402587 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399764 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399766 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399769 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399772 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399774 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399777 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399780 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399783 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399785 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399788 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399791 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399793 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399796 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399799 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399802 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399805 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399810 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399813 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399816 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.403048 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399819 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399821 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399824 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399826 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399829 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399832 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399835 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399837 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399839 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399842 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399845 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399848 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399850 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.399854 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400338 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400344 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400347 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400350 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400353 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400355 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.403530 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400358 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400361 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400364 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400367 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400369 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400375 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400379 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400384 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400386 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400389 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400392 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400395 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400398 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400401 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400403 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400406 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400408 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400411 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400414 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.404054 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400419 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400421 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400424 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400427 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400430 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400432 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400435 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400438 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400441 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400443 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400446 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400448 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400451 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400454 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400456 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400459 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400461 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400464 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400466 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400469 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.404542 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400472 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400475 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400477 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400480 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400482 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400485 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400488 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400491 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400493 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400496 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400498 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400501 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400505 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400507 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400510 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400513 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400517 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400519 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400522 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.405022 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400524 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400529 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400533 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400536 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400539 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400541 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400544 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400547 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400549 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400552 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400555 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400558 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400560 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400563 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400566 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400569 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400572 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400574 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400577 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.405498 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400580 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400582 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400585 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400587 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400590 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400592 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400596 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400599 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400601 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400604 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400606 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400609 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400612 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400614 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400618 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400621 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400623 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400626 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400629 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.405964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400631 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400634 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400636 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.400639 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400731 4406 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400747 4406 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400752 4406 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400757 4406 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400762 4406 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400765 4406 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400769 4406 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400773 4406 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400777 4406 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400780 4406 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400783 4406 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400787 4406 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400790 4406 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400793 4406 flags.go:64] FLAG: --cgroup-root="" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400796 4406 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400801 4406 flags.go:64] FLAG: --client-ca-file="" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400804 4406 flags.go:64] FLAG: --cloud-provider="external" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400807 4406 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400811 4406 flags.go:64] FLAG: --cluster-domain="" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400814 4406 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 07:28:13.406669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400817 4406 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400820 4406 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400824 4406 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400829 4406 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400832 4406 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400835 4406 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400838 4406 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400841 4406 flags.go:64] FLAG: --contention-profiling="false" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400844 4406 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400848 4406 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400851 4406 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400853 4406 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400858 4406 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400861 4406 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400864 4406 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400867 4406 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400870 4406 flags.go:64] FLAG: --enable-server="true" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400873 4406 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400878 4406 flags.go:64] FLAG: --event-burst="100" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400881 4406 flags.go:64] FLAG: --event-qps="50" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400884 4406 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400887 4406 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400890 4406 flags.go:64] FLAG: --eviction-hard="" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400894 4406 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 07:28:13.407663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400897 4406 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400900 4406 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400903 4406 flags.go:64] FLAG: --eviction-soft="" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400907 4406 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400911 4406 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400913 4406 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400916 4406 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400919 4406 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400923 4406 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400926 4406 flags.go:64] FLAG: --feature-gates="" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400930 4406 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400935 4406 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400939 4406 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400942 4406 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400945 4406 flags.go:64] FLAG: --healthz-port="10248" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400948 4406 flags.go:64] FLAG: --help="false" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400951 4406 flags.go:64] FLAG: --hostname-override="ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400954 4406 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400957 4406 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400960 4406 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400963 4406 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400967 4406 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400970 4406 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 07:28:13.408385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400972 4406 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400975 4406 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400978 4406 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400982 4406 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400985 4406 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400988 4406 flags.go:64] FLAG: --kube-reserved="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400990 4406 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400993 4406 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400996 4406 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.400999 4406 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401003 4406 flags.go:64] FLAG: --lock-file="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401005 4406 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401010 4406 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401013 4406 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401018 4406 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401021 4406 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401024 4406 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401027 4406 flags.go:64] FLAG: --logging-format="text" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401031 4406 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401034 4406 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401039 4406 flags.go:64] FLAG: --manifest-url="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401042 4406 flags.go:64] FLAG: --manifest-url-header="" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401046 4406 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401049 4406 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401053 4406 flags.go:64] FLAG: --max-pods="110" Oct 31 07:28:13.408945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401056 4406 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401059 4406 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401062 4406 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401065 4406 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401068 4406 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401071 4406 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401074 4406 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401081 4406 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401084 4406 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401087 4406 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401090 4406 flags.go:64] FLAG: --pod-cidr="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401094 4406 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401097 4406 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401100 4406 flags.go:64] FLAG: --pods-per-core="0" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401103 4406 flags.go:64] FLAG: --port="10250" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401106 4406 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401109 4406 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0203c7dddc93d4d78" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401112 4406 flags.go:64] FLAG: --qos-reserved="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401115 4406 flags.go:64] FLAG: --read-only-port="10255" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401119 4406 flags.go:64] FLAG: --register-node="true" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401122 4406 flags.go:64] FLAG: --register-with-taints="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401125 4406 flags.go:64] FLAG: --registry-burst="10" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401128 4406 flags.go:64] FLAG: --registry-qps="5" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401131 4406 flags.go:64] FLAG: --reserved-cpus="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401134 4406 flags.go:64] FLAG: --reserved-memory="" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401138 4406 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 07:28:13.409560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401141 4406 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401145 4406 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401148 4406 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401151 4406 flags.go:64] FLAG: --runonce="false" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401154 4406 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401157 4406 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401160 4406 flags.go:64] FLAG: --seccomp-default="false" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401163 4406 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401166 4406 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401169 4406 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401172 4406 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401175 4406 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401178 4406 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401181 4406 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401184 4406 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401187 4406 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401190 4406 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401193 4406 flags.go:64] FLAG: --system-cgroups="" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401197 4406 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401202 4406 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401205 4406 flags.go:64] FLAG: --tls-cert-file="" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401208 4406 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401213 4406 flags.go:64] FLAG: --tls-min-version="" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401216 4406 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401218 4406 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 07:28:13.410183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401221 4406 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401224 4406 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401227 4406 flags.go:64] FLAG: --v="2" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401231 4406 flags.go:64] FLAG: --version="false" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401236 4406 flags.go:64] FLAG: --vmodule="" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401240 4406 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401243 4406 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401386 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401391 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401394 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401397 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401400 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401403 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401406 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401409 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401411 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401414 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401417 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401419 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401422 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401424 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.410872 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401427 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401430 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401432 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401435 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401438 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401444 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401447 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401450 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401452 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401455 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401458 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401461 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401463 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401466 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401469 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401471 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401474 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401476 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401479 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401483 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.411497 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401485 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401488 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401490 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401493 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401496 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401498 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401501 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401504 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401506 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401509 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401511 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401514 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401518 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401522 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401526 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401529 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401532 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401534 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401537 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.411990 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401540 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401543 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401545 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401548 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401550 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401553 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401556 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401559 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401561 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401564 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401566 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401569 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401573 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401576 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401578 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401581 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401585 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401588 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401591 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.412562 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401593 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401596 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401598 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401601 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401604 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401606 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401609 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401611 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401614 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401617 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401620 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401622 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401625 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401628 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401631 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401633 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401636 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401638 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401641 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401643 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.413020 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401646 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401648 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401651 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401653 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401656 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401660 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401662 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401666 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401670 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401674 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401677 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401680 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401683 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401686 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.401711 4406 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401744 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.413691 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401748 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401751 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401755 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401758 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401761 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401763 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401766 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401769 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401772 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401774 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401777 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401780 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401783 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401785 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401788 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401791 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401793 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401796 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401798 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401801 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.414182 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401804 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401807 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401811 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401814 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401817 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401821 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401823 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401826 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401829 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401831 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401835 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401839 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401842 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401844 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401847 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401850 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401852 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401855 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401858 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.415073 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401860 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401863 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401866 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401868 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401871 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401874 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401877 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401879 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401882 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401885 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401887 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401890 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401893 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401896 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401900 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401906 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401910 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401917 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401923 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.415735 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401926 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401929 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401932 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401934 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401937 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401940 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401942 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401945 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401947 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401951 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401953 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401956 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401958 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401961 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401964 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401966 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401968 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401971 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401974 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401977 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.416318 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401981 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401983 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401986 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401988 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401992 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401996 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.401999 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402002 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402007 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402010 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402014 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402018 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402020 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402023 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402026 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402029 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402031 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402035 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402037 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402040 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.416866 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402043 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402045 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402048 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402051 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402053 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402056 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.402058 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.407733 4406 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.407756 4406 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.407784 4406 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.407789 4406 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407857 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407862 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407865 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407869 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407871 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407874 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407877 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407882 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.417461 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407885 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407889 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407892 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407895 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407898 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407900 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407903 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407909 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407912 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407914 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407917 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407920 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407922 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407925 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407928 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407930 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407933 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407936 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407938 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407942 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.417939 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407944 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407947 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407950 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407953 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407956 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407958 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407961 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407964 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407966 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407969 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407972 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407975 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407977 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407980 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407982 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407987 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407990 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.407994 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408004 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.418436 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408008 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408011 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408013 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408016 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408019 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408022 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408025 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408028 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408030 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408033 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408035 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408039 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408042 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408044 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408047 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408049 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408052 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408055 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408058 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.418896 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408060 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408063 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408065 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408068 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408070 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408073 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408076 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408078 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408081 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408083 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408086 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408088 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408091 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408100 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408103 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408106 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408108 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408111 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408113 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.419366 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408116 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408119 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408122 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408125 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408128 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408130 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408133 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408135 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408138 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408140 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408144 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408146 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408149 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408151 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408154 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408157 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408160 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408162 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408165 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408167 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.419825 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408170 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.408197 4406 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408366 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408371 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408375 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408379 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408381 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408390 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408393 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408396 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408399 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408402 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408405 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408408 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408411 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408413 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.420337 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408416 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408419 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408421 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408424 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408426 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408429 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408431 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408434 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408437 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408440 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408442 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408445 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408447 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408450 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408453 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408455 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408458 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408461 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408463 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408466 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.420815 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408468 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408471 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408474 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408478 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408486 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408490 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408493 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408497 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408501 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408504 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408506 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408509 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408512 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408515 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408517 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408520 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408522 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408525 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.421323 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408527 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408530 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408532 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408535 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408537 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408540 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408542 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408545 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408548 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408551 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408554 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408556 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408559 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408561 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408564 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408566 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408569 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408572 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408575 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.421747 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408582 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408585 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408587 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408590 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408593 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408595 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408598 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408601 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408603 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408606 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408608 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408611 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408614 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408616 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408619 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408622 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408624 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408627 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408630 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408632 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.422209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408635 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408638 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408640 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408643 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408645 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408648 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408650 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408653 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408655 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408657 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408660 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408663 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408665 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408673 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408676 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.408700 4406 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 07:28:13.422769 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408738 4406 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408743 4406 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408746 4406 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408750 4406 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408754 4406 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408758 4406 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408761 4406 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408763 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408766 4406 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408769 4406 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408771 4406 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408774 4406 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408777 4406 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408779 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408782 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408785 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408787 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408790 4406 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408792 4406 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 07:28:13.423139 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408795 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408797 4406 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408800 4406 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408802 4406 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408805 4406 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408807 4406 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408813 4406 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408816 4406 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408818 4406 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408821 4406 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408824 4406 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408831 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408835 4406 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408838 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408840 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408843 4406 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408846 4406 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408848 4406 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408851 4406 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408854 4406 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 07:28:13.423722 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408856 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408859 4406 feature_gate.go:386] unrecognized feature gate: Example Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408861 4406 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408864 4406 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408866 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408870 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408872 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408875 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408878 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408880 4406 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408883 4406 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408885 4406 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408888 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408890 4406 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408893 4406 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408895 4406 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408898 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408901 4406 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408905 4406 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408908 4406 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 07:28:13.424564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408910 4406 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408914 4406 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408917 4406 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408920 4406 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408927 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408930 4406 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408932 4406 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408935 4406 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408938 4406 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408940 4406 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408943 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408945 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408948 4406 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408950 4406 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408953 4406 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408956 4406 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408959 4406 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408961 4406 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408964 4406 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408967 4406 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 07:28:13.425067 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408969 4406 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408972 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408974 4406 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408977 4406 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408980 4406 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408982 4406 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408985 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408988 4406 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408990 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408993 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408996 4406 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.408999 4406 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409002 4406 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409006 4406 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409009 4406 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409012 4406 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409014 4406 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409022 4406 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409025 4406 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409027 4406 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 07:28:13.425571 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409030 4406 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409032 4406 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409035 4406 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409037 4406 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409040 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409043 4406 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:13.409047 4406 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.409122 4406 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410104 4406 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410159 4406 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410347 4406 server.go:1014] "Starting client certificate rotation" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410483 4406 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410536 4406 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:22:33 +0000 UTC" deadline="2028-05-28 10:39:05.385542661 +0000 UTC" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410575 4406 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13803h10m51.974969208s" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.410930 4406 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 07:28:13.426086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.412125 4406 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 07:28:13.426486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.413689 4406 log.go:25] "Validated CRI v1 runtime API" Oct 31 07:28:13.426486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.415563 4406 log.go:25] "Validated CRI v1 image API" Oct 31 07:28:13.426486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.416272 4406 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 07:28:13.426486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.417693 4406 fs.go:135] Filesystem UUIDs: map[0f97840e-1f81-4af3-a9d5-58ae8ecc7902:/dev/nvme0n1p4 7013c8c1-0957-4f60-8f97-dc8660287aa9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 31 07:28:13.426602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.417713 4406 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/60267fcaae875f87d626558f173468b180d3b37e63d4224c0c48fe8b7a3b5a9b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/60267fcaae875f87d626558f173468b180d3b37e63d4224c0c48fe8b7a3b5a9b/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6/userdata/shm major:0 minor:100 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12a7b750-341e-40b7-a425-5a452187e803/volumes/kubernetes.io~projected/kube-api-access-blpxg:{mountpoint:/var/lib/kubelet/pods/12a7b750-341e-40b7-a425-5a452187e803/volumes/kubernetes.io~projected/kube-api-access-blpxg major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20df0d97-58e7-42de-a1c0-e195bc62abca/volumes/kubernetes.io~projected/kube-api-access-dnj8c:{mountpoint:/var/lib/kubelet/pods/20df0d97-58e7-42de-a1c0-e195bc62abca/volumes/kubernetes.io~projected/kube-api-access-dnj8c major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21a6f12f-fda5-4424-9e56-6a0ca7387aaf/volumes/kubernetes.io~projected/kube-api-access-5h9xq:{mountpoint:/var/lib/kubelet/pods/21a6f12f-fda5-4424-9e56-6a0ca7387aaf/volumes/kubernetes.io~projected/kube-api-access-5h9xq major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5312dbea-fea7-4156-9f54-594964546777/volumes/kubernetes.io~projected/kube-api-access-5n2lc:{mountpoint:/var/lib/kubelet/pods/5312dbea-fea7-4156-9f54-594964546777/volumes/kubernetes.io~projected/kube-api-access-5n2lc major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~projected/kube-api-access-x7qk5:{mountpoint:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~projected/kube-api-access-x7qk5 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/612b66f6-ebbd-40d4-87a9-3ced431e0a0f/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/612b66f6-ebbd-40d4-87a9-3ced431e0a0f/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8697ef31-6a1d-4d75-a5a8-2d715991cfef/volumes/kubernetes.io~projected/kube-api-access-lkzvd:{mountpoint:/var/lib/kubelet/pods/8697ef31-6a1d-4d75-a5a8-2d715991cfef/volumes/kubernetes.io~projected/kube-api-access-lkzvd major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~projected/kube-api-access-bjvnc:{mountpoint:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~projected/kube-api-access-bjvnc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~projected/kube-api-access-vfkrq:{mountpoint:/var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~projected/kube-api-access-vfkrq major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~secret/metrics-certs major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a77a849d-a548-4916-9c49-ca1aa09594e8/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/a77a849d-a548-4916-9c49-ca1aa09594e8/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c115d685-21cd-4266-b6ee-49277e579096/volumes/kubernetes.io~projected/kube-api-access-zmbhz:{mountpoint:/var/lib/kubelet/pods/c115d685-21cd-4266-b6ee-49277e579096/volumes/kubernetes.io~projected/kube-api-access-zmbhz major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcca29ae-118f-4d8e-9dca-47c6f152f234/volumes/kubernetes.io~projected/kube-api-access-6h4vq:{mountpoint:/var/lib/kubelet/pods/fcca29ae-118f-4d8e-9dca-47c6f152f234/volumes/kubernetes.io~projected/kube-api-access-6h4vq major:0 minor:65 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/5bb596643f56f2b50519a8e4fe1d06178d1effa687789b57720548794e724045/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/7fcfb13ef9a97b481b3fb3896551d08c2350adc2e31b1b572b14666157845301/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/d820d2171aaa69af6b2577c80865b79f10df081c0643bf92c9d2906ab181be56/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/f812e8189b294689839125d562ba6d61defdc3bf61908b74a12e586176bfd54c/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/aa9aa31474ba1487da185d2642b2913b23f564312ce36d245364a93b274092b7/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/f54795f737886c7fcbc143dafec7910b6a6a90b1225c26d6e7e4c4bbc4fe7bed/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/aaa3eb3d848c4d7c4a76ae62ed557561da0fd63190a29de18803cb9260998107/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/6c90a36934ae4a6c0a5641c7ff7910984f5f51657b2152ba9472d2d2db065695/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2482f777459150169aacd798f5c6852dc01f1cf77643c862f686e40afc126c89/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/08281803fd964b1eb4da2d24b8ef7e398216cba7d7a4bc5f24a30a73c1aadd59/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/ab4c3f024e310b9dab11b6e6a403c21026c5c5a907d8c9a39a00f1691e75e181/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/265a3d4bd38d98971ebaf20b8293cf598bea9f72a00537e23a8c46cf1ea764ad/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/74563db02e859f9f3717c82b0116715aebc9a26fb1f011b77b6166dedcf13168/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/5c3c0022c191a32a7abd4faa4aca344f9001dff42db22577fa8ee63d93eb3e09/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/58c3327601827cd64ff87fa2666f48c72d5d33699052f27a2f01b517eb59c080/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/7bb57752ab7952b6beb0df323b0b2bbafb0580c826f07fc1285472d01f6ee0d5/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/d2581cc2941a49098e723d4d586ab1d28e6a93f1ae373373c8ee26db142fa962/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/11228e77307b56acbf178191fb6a122c7d99abc4c73412b8068e173497e3f25b/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/c0b26ff26ad026b43f84aa8a681f87f6a4dd0c915afb76f1c28507ace72ce038/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e96429fdcfc8a10902405f97f4cdc3ac833aef86b2b77eef1e0f0f7d4152bb4b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-208:{mountpoint:/var/lib/containers/storage/overlay/1e1f2d00745dd8a72b1467732467896ffe38b563bef68147538a79f5e15ea153/merged major:0 minor:208 fsType:overlay blockSize:0} overlay_0-210:{mountpoint:/var/lib/containers/storage/overlay/cd048e82f4b6c469c8bcc419e08afeefb74a80e626f38fb19af4deb8eb7f4b0a/merged major:0 minor:210 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/2e89ff2634af8cbf1c954287471774de8943456de80334a6b181fb4a40b384f7/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/5fc424c39106221f142265e99f2c77ca33b43bd79720d66446d3569d657a85a0/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/2869b9f30d243000f1da31f61ab4a46471b8558f32313bda43ad7d5e46d9a50d/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/6117568ca024d189d1cb04e92473ba96142a59d1a7bd741f46419ab02c2447a7/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/9365c4bbf4c0169b859c3c91d587402f35979c175388de7c979c3d61782d2d4a/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/2a62491baf6ee26547af480aca9eab374a0783d9a750958b415359c379d2e803/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/63ef09bbbf2a74c165d655a746bce3275d5db343a87fb33103a0b7fa7bd0cb02/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/ffeb73e963a0f5d768b0685b8c42dd5a21d26adac7876335d902b2fb5bb43aec/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/6de848f984f3664879d51f689b6a3be82fa99477506ca7b5e74fc3c77297bd2d/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/5fda11775651d4728159b6d00e503c7063b4f6cd673b3ab967b45fc2e4c94c58/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/630adb641f93ac99a6c76cf326f0a7cc1cdae5c7430c9f22759ef3709310010a/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/5b62d8db1ed47de8e7ff34b8fcac51aa4d042e12e94530cffab34e469eda725a/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/4467c2f473c6915db19afed07b1cfc83bf16f9bedc95d146332d7cdee4d1b2cb/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-91:{mountpoint:/var/lib/containers/storage/overlay/a472ca5599b2994a388ffa51f95f9176bb24dba327be38fcd9fceb03c0a28860/merged major:0 minor:91 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/40a9fa138bb69b6f89b9bffe1753465b4359351730bbe3a2101525ccdf53dfb0/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/03aa7895bc3bf65ff2ec062e17cf1355e19602f121b7b9f26312d85ebfc30f81/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425183 4406 manager.go:217] Machine: {Timestamp:2026-10-31 07:28:13.424229424 +0000 UTC m=+0.071228697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099450 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ef6fb0d7ad2ae92bf09dec2078c2e SystemUUID:ec2ef6fb-0d7a-d2ae-92bf-09dec2078c2e BootID:834808fe-e09d-4a79-9743-457ec0ebb678 Filesystems:[{Device:/run/containers/storage/overlay-containers/60267fcaae875f87d626558f173468b180d3b37e63d4224c0c48fe8b7a3b5a9b/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90da12425d7cac61b5c55d55dddd296c71033195cf754fad61feb47542746fef/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c84cd29ac1596c76731a8ec47507a011125241602501e0c90dfbb3d82c6fee9/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-208 DeviceMajor:0 DeviceMinor:208 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fcca29ae-118f-4d8e-9dca-47c6f152f234/volumes/kubernetes.io~projected/kube-api-access-6h4vq DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a77a849d-a548-4916-9c49-ca1aa09594e8/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20df0d97-58e7-42de-a1c0-e195bc62abca/volumes/kubernetes.io~projected/kube-api-access-dnj8c DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b7cda5ba2dda7039a678f331caac905de0718ed72a54a20dd03d8dc3fed00be6/userdata/shm DeviceMajor:0 DeviceMinor:100 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-91 DeviceMajor:0 DeviceMinor:91 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-210 DeviceMajor:0 DeviceMinor:210 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/612b66f6-ebbd-40d4-87a9-3ced431e0a0f/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e3696278c2bedcc83c6c068fbc7699ae2d389c39e36e65ddf4dc422d2adc7224/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c115d685-21cd-4266-b6ee-49277e579096/volumes/kubernetes.io~projected/kube-api-access-zmbhz DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cffe8cda4b5967afecab46cf9ba6da62483667a19ac03a22ca997d2021ed26db/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74343f39e8ab601e57a249fd55aced004eb87d4bb3c2256b89e12ae4cd2aa9bd/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3001ced-ad94-48ad-b282-06a2a531606c/volumes/kubernetes.io~projected/kube-api-access-vfkrq DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/8697ef31-6a1d-4d75-a5a8-2d715991cfef/volumes/kubernetes.io~projected/kube-api-access-lkzvd DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~projected/kube-api-access-bjvnc DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~projected/kube-api-access-x7qk5 DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3de030a272d9658807d72cd4aea6dd44a11b7e4cbd8a200c7c0a5c46e262d23d/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/21a6f12f-fda5-4424-9e56-6a0ca7387aaf/volumes/kubernetes.io~projected/kube-api-access-5h9xq DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/da3d5ab450bf707ce9342a5252b673cccd18cee51a545cb2eae427c0d08a7989/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9374723a-d550-4425-9fb9-380fd3784945/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/12a7b750-341e-40b7-a425-5a452187e803/volumes/kubernetes.io~projected/kube-api-access-blpxg DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dfd9029b384165fbafba0d9546d37c15bda5f1c01393179b151ecc0a182a13d0/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2a96ac-7c93-474c-a4ad-9b0091d95209/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b97fb9638b3b388a1b2f012be53c15582dfd9affda53143caa0c3f90777a7f70/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5312dbea-fea7-4156-9f54-594964546777/volumes/kubernetes.io~projected/kube-api-access-5n2lc DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:b97fb9638b3b388 MacAddress:ee:18:33:2e:d5:09 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:cc:39:54:c1 Speed:0 Mtu:9001} {Name:br-int MacAddress:42:83:a7:05:66:ed Speed:0 Mtu:8901} {Name:da3d5ab450bf707 MacAddress:d2:59:6e:bf:4b:2a Speed:10000 Mtu:8901} {Name:e3696278c2bedcc MacAddress:76:18:de:03:19:ec Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:cc:39:54:c1 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:62:98:9f:c6:02:e2 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:9d:5b:59:22:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425424 4406 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425466 4406 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425733 4406 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425753 4406 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425877 4406 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425885 4406 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425898 4406 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425911 4406 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.425981 4406 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426137 4406 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426238 4406 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426287 4406 kubelet.go:493] "Attempting to sync node with API server" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426299 4406 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426309 4406 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426317 4406 kubelet.go:405] "Adding apiserver pod source" Oct 31 07:28:13.426721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426325 4406 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 07:28:13.427209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.426989 4406 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 07:28:13.427209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.427001 4406 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 07:28:13.427466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.427446 4406 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 07:28:13.429343 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429305 4406 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 07:28:13.429343 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429320 4406 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 07:28:13.429487 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429420 4406 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 31 07:28:13.429608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429597 4406 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 07:28:13.429637 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429625 4406 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 07:28:13.429734 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429723 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 07:28:13.429776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429743 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 07:28:13.429776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429753 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 07:28:13.429776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429760 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 07:28:13.429776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429770 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429779 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429798 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429804 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429814 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429820 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429832 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429842 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429870 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 07:28:13.429890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.429879 4406 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 07:28:13.433188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.433175 4406 server.go:1263] "Started kubelet" Oct 31 07:28:13.433285 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.433233 4406 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 07:28:13.434309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.433503 4406 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 07:28:13.434309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.433668 4406 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 07:28:13.433833 ip-10-0-136-217 systemd[1]: Started Kubernetes Kubelet. Oct 31 07:28:13.434641 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.434547 4406 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 07:28:13.435543 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.435525 4406 server.go:317] "Adding debug handlers to kubelet server" Oct 31 07:28:13.438549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.437569 4406 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 07:28:13.438549 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.438116 4406 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-217.ec2.internal\" not found" Oct 31 07:28:13.438549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.438156 4406 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 07:28:13.438549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.438314 4406 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:35 +0000 UTC" deadline="2028-06-12 21:19:51.000032492 +0000 UTC" Oct 31 07:28:13.438549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.438362 4406 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14173h51m37.561674655s" Oct 31 07:28:13.439544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.439003 4406 factory.go:55] Registering systemd factory Oct 31 07:28:13.439544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.439024 4406 factory.go:223] Registration of the systemd container factory successfully Oct 31 07:28:13.439544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.439109 4406 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 07:28:13.439544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.439173 4406 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 07:28:13.439544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.439404 4406 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 07:28:13.440772 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.440752 4406 factory.go:153] Registering CRI-O factory Oct 31 07:28:13.440772 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.440772 4406 factory.go:223] Registration of the crio container factory successfully Oct 31 07:28:13.440897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.440830 4406 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 07:28:13.440897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.440846 4406 factory.go:103] Registering Raw factory Oct 31 07:28:13.440897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.440861 4406 manager.go:1199] Started watching for new ooms in manager Oct 31 07:28:13.441128 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.441117 4406 manager.go:319] Starting recovery of all containers Oct 31 07:28:13.441962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.441919 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c115d685-21cd-4266-b6ee-49277e579096" volumeName="kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca" seLinuxMountContext="" Oct 31 07:28:13.442033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.441976 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c115d685-21cd-4266-b6ee-49277e579096" volumeName="kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz" seLinuxMountContext="" Oct 31 07:28:13.442033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.441994 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcca29ae-118f-4d8e-9dca-47c6f152f234" volumeName="kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir" seLinuxMountContext="" Oct 31 07:28:13.442033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442011 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcca29ae-118f-4d8e-9dca-47c6f152f234" volumeName="kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq" seLinuxMountContext="" Oct 31 07:28:13.442033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442027 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12a7b750-341e-40b7-a425-5a452187e803" volumeName="kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442040 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12a7b750-341e-40b7-a425-5a452187e803" volumeName="kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442120 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12a7b750-341e-40b7-a425-5a452187e803" volumeName="kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442136 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="612b66f6-ebbd-40d4-87a9-3ced431e0a0f" volumeName="kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442157 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9374723a-d550-4425-9fb9-380fd3784945" volumeName="kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442184 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9374723a-d550-4425-9fb9-380fd3784945" volumeName="kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442203 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a77a849d-a548-4916-9c49-ca1aa09594e8" volumeName="kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs" seLinuxMountContext="" Oct 31 07:28:13.442219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442216 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12a7b750-341e-40b7-a425-5a452187e803" volumeName="kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442243 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20df0d97-58e7-42de-a1c0-e195bc62abca" volumeName="kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442279 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9374723a-d550-4425-9fb9-380fd3784945" volumeName="kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442335 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9374723a-d550-4425-9fb9-380fd3784945" volumeName="kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442361 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3001ced-ad94-48ad-b282-06a2a531606c" volumeName="kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442374 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20df0d97-58e7-42de-a1c0-e195bc62abca" volumeName="kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442392 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20df0d97-58e7-42de-a1c0-e195bc62abca" volumeName="kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442415 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21a6f12f-fda5-4424-9e56-6a0ca7387aaf" volumeName="kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442457 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2a96ac-7c93-474c-a4ad-9b0091d95209" volumeName="kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442471 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2a96ac-7c93-474c-a4ad-9b0091d95209" volumeName="kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442495 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8697ef31-6a1d-4d75-a5a8-2d715991cfef" volumeName="kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442525 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9374723a-d550-4425-9fb9-380fd3784945" volumeName="kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc" seLinuxMountContext="" Oct 31 07:28:13.442547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442537 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3001ced-ad94-48ad-b282-06a2a531606c" volumeName="kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs" seLinuxMountContext="" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442567 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5312dbea-fea7-4156-9f54-594964546777" volumeName="kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc" seLinuxMountContext="" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442589 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2a96ac-7c93-474c-a4ad-9b0091d95209" volumeName="kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp" seLinuxMountContext="" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442605 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8697ef31-6a1d-4d75-a5a8-2d715991cfef" volumeName="kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd" seLinuxMountContext="" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442631 4406 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a77a849d-a548-4916-9c49-ca1aa09594e8" volumeName="kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca" seLinuxMountContext="" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442644 4406 reconstruct.go:97] "Volume reconstruction finished" Oct 31 07:28:13.442882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.442651 4406 reconciler.go:29] "Reconciler: start to sync state" Oct 31 07:28:13.467139 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.467103 4406 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 07:28:13.469426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.469403 4406 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 07:28:13.469540 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.469432 4406 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 07:28:13.469540 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.469462 4406 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 07:28:13.469540 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.469503 4406 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 31 07:28:13.477841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.477819 4406 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:28:13.478082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.478067 4406 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 31 07:28:13.479488 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.479461 4406 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:28:13.490290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.490269 4406 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:28:13.494432 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.494396 4406 generic.go:356] "Generic (PLEG): container finished" podID="2c3e4fbccff2ad1877ba003792ae09ae" containerID="4cfa0fa4eb2d3f43b2e887ea51406472ce7b35562cae4d0484b12f0dc1376712" exitCode=0 Oct 31 07:28:13.499535 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.499509 4406 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 07:28:13.502675 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502653 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="8e25f8288ecb06bdfb276785a0d469b9335da360f0705dcc8322d593c972e0ce" exitCode=0 Oct 31 07:28:13.502675 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502673 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="c3bcbbde3d833b23c875ca1c3d1c4445d1d207cf6c04a3641bc67f01dcfee8b7" exitCode=0 Oct 31 07:28:13.502675 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502679 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="79fc7c336df8fc2adcbc83556b8a3658f02f2ecac620d773539b789c56120c83" exitCode=0 Oct 31 07:28:13.502846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502687 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="92af5c0572523aecd99b463f89039621f1ac42f86b6840a09a0470239b3e1f7e" exitCode=0 Oct 31 07:28:13.502846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502692 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="4b2f8d5579a5c577dba8f8d6f1fc881ff890784520096619aecd0d0ec559c807" exitCode=0 Oct 31 07:28:13.502846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.502697 4406 generic.go:356] "Generic (PLEG): container finished" podID="12a7b750-341e-40b7-a425-5a452187e803" containerID="1cb690b9204e22d3fa96e79022a3216a74e124e35ae67db5b15605160bc30d0b" exitCode=0 Oct 31 07:28:13.507349 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.507333 4406 manager.go:324] Recovery completed Oct 31 07:28:13.519980 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.519929 4406 cpu_manager.go:226] "Starting" policy="none" Oct 31 07:28:13.519980 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.519942 4406 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 07:28:13.519980 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.519957 4406 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 07:28:13.520305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520281 4406 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 31 07:28:13.520377 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520308 4406 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 31 07:28:13.520426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520384 4406 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 31 07:28:13.520426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520394 4406 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 31 07:28:13.520426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520402 4406 policy_none.go:50] "Start" Oct 31 07:28:13.520426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520425 4406 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 07:28:13.520594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520442 4406 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 07:28:13.520693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520677 4406 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 31 07:28:13.520744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520696 4406 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 31 07:28:13.520744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.520704 4406 policy_none.go:44] "Start" Oct 31 07:28:13.525702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.525678 4406 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 07:28:13.528320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.528308 4406 manager.go:341] "Starting Device Plugin manager" Oct 31 07:28:13.528802 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.528332 4406 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 07:28:13.528802 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.528803 4406 server.go:87] "Starting device plugin registration server" Oct 31 07:28:13.529041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529030 4406 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 07:28:13.529100 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529041 4406 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 07:28:13.529154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529143 4406 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 07:28:13.529307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529259 4406 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 07:28:13.529408 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529331 4406 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 07:28:13.529408 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529347 4406 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 07:28:13.529520 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.529407 4406 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:28:13.529301729Z","UUID":"da8d05f4-70e1-42f4-9589-0a49e18f1e2f","Handler":null,"Name":"","Endpoint":""} Oct 31 07:28:13.530304 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.530215 4406 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 07:28:13.530800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.530781 4406 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 07:28:13.530885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.530811 4406 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 07:28:13.570488 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.570446 4406 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal"] Oct 31 07:28:13.570913 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.570875 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" event={"ID":"d3f83b034c7f4b2860ef8c40782c16cd","Type":"ContainerStarted","Data":"9114206877fcc1fb2601862bac1826c09d90d25e8fb76ab0e3367b86f0a57bb7"} Oct 31 07:28:13.571022 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.570931 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" event={"ID":"d3f83b034c7f4b2860ef8c40782c16cd","Type":"ContainerStarted","Data":"23c84a7348c8654e8a77641d47523223e1fffc37bbff88234a9289ad9a354ec9"} Oct 31 07:28:13.571022 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.570993 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerStarted","Data":"74a4af2a0599fa3f2463c548e13d0211686313761701fcd0cadc4060a5f1395a"} Oct 31 07:28:13.571022 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.571014 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerDied","Data":"4cfa0fa4eb2d3f43b2e887ea51406472ce7b35562cae4d0484b12f0dc1376712"} Oct 31 07:28:13.571181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.571033 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" event={"ID":"2c3e4fbccff2ad1877ba003792ae09ae","Type":"ContainerStarted","Data":"3583989da4ab6304496dcd85981fa8e107eb657d02b992c06f61874387123f47"} Oct 31 07:28:13.571181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.571080 4406 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.571181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.571111 4406 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.591528 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.591508 4406 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:28:13.591619 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.591555 4406 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.591795 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.591784 4406 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:28:13.591830 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:13.591808 4406 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.629932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.629910 4406 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 07:28:13.631213 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.631198 4406 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientMemory" Oct 31 07:28:13.631305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.631225 4406 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasNoDiskPressure" Oct 31 07:28:13.631305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.631235 4406 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-217.ec2.internal" event="NodeHasSufficientPID" Oct 31 07:28:13.631305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.631280 4406 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.661624 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.661604 4406 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.661685 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.661661 4406 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.679163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.679138 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.679277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.679165 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.679277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.679184 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779710 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779764 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779792 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779794 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779825 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f83b034c7f4b2860ef8c40782c16cd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" (UID: \"d3f83b034c7f4b2860ef8c40782c16cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:13.779932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:13.779886 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3e4fbccff2ad1877ba003792ae09ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" (UID: \"2c3e4fbccff2ad1877ba003792ae09ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:14.426917 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.426877 4406 apiserver.go:52] "Watching apiserver" Oct 31 07:28:14.462030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.462004 4406 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 07:28:14.462391 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.462373 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wjqj5","kube-system/konnectivity-agent-nlstp","openshift-dns/node-resolver-ffhvf","openshift-image-registry/node-ca-d6ltq","openshift-multus/network-metrics-daemon-gn94r","openshift-network-operator/iptables-alerter-86hqz","openshift-multus/multus-additional-cni-plugins-cxnxp","openshift-multus/multus-qgqtb","openshift-network-diagnostics/network-check-target-2gtzn","openshift-ovn-kubernetes/ovnkube-node-p9l6j","kube-system/global-pull-secret-syncer-tptr8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5"] Oct 31 07:28:14.475999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.475972 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.476108 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476089 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.476317 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476300 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.476386 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476345 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.476617 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476603 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.476959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476926 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xhs6v\"" Oct 31 07:28:14.476959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476939 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 07:28:14.476959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.476956 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 07:28:14.477413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477394 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nzlr\"" Oct 31 07:28:14.477413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477403 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qk9pc\"" Oct 31 07:28:14.477413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477424 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 07:28:14.477666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477642 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gjb5j\"" Oct 31 07:28:14.477757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477744 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 07:28:14.477822 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.477810 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtmc6\"" Oct 31 07:28:14.484596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.484577 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 07:28:14.484809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.484790 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.484809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.484805 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7l5b\"" Oct 31 07:28:14.484933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.484820 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.485101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485086 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 07:28:14.485101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485089 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.485205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485115 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 07:28:14.485205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485127 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 07:28:14.485205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485147 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.485205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485155 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 07:28:14.485361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485335 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hgtls\"" Oct 31 07:28:14.485577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485562 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n7m4f\"" Oct 31 07:28:14.485616 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.485610 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6ssn\"" Oct 31 07:28:14.486449 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.486426 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-548vl\"" Oct 31 07:28:14.488795 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488771 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vgg5g\"" Oct 31 07:28:14.488881 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488828 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.488881 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488839 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fh9bq\"" Oct 31 07:28:14.488881 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488855 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488890 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488896 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488834 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488911 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488922 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488901 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488876 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488970 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.488984 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.489042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.489043 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 07:28:14.489359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.489322 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 07:28:14.506960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.506943 4406 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:14.507056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.507045 4406 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:14.525411 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.525394 4406 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:28:14.525477 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:14.525430 4406 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-217.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-217.ec2.internal" Oct 31 07:28:14.525926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.525915 4406 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 07:28:14.525959 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:14.525943 4406 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-217.ec2.internal" Oct 31 07:28:14.540157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.540138 4406 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 07:28:14.583700 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583679 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.583818 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583709 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:14.583818 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583728 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.583818 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583747 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.583818 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583772 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.583985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583818 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.583985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583878 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-tmp\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.583985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583891 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.583985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583935 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.583985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.583967 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584003 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3001ced-ad94-48ad-b282-06a2a531606c-metrics-certs\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584062 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584078 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584120 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584147 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9374723a-d550-4425-9fb9-380fd3784945-ovn-node-metrics-cert\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584156 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584193 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584222 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584238 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584281 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584311 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584338 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.584387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584376 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584409 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584466 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584483 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584499 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584515 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584551 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584582 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584612 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584641 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.584667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584667 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584692 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584720 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzvd\" (UniqueName: \"kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584774 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584791 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-script-lib\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584795 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584842 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584866 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584887 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584899 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-tuned\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584887 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-ovnkube-config\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584922 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:28:14.585041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.584991 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585056 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9374723a-d550-4425-9fb9-380fd3784945-env-overrides\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585092 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585157 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpxg\" (UniqueName: \"kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585197 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585232 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585264 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a77a849d-a548-4916-9c49-ca1aa09594e8-konnectivity-ca\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585273 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a77a849d-a548-4916-9c49-ca1aa09594e8-agent-certs\") pod \"konnectivity-agent-nlstp\" (UID: \"a77a849d-a548-4916-9c49-ca1aa09594e8\") " pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585276 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585320 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585342 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbhz\" (UniqueName: \"kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585367 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n2lc\" (UniqueName: \"kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585401 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585422 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585458 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.585530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585530 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585551 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585592 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585623 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkrq\" (UniqueName: \"kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585638 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585744 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585764 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585780 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585814 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585849 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8697ef31-6a1d-4d75-a5a8-2d715991cfef-iptables-alerter-script\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585917 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnj8c\" (UniqueName: \"kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585937 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585954 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585972 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.585981 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-original-pull-secret\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586006 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586078 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qk5\" (UniqueName: \"kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586082 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcca29ae-118f-4d8e-9dca-47c6f152f234-tmp-dir\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.586113 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586112 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586133 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586164 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586192 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586241 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvnc\" (UniqueName: \"kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586286 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586310 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586332 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586336 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c115d685-21cd-4266-b6ee-49277e579096-serviceca\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586355 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586438 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586460 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586475 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586519 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586543 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586579 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-daemon-config\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586594 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20df0d97-58e7-42de-a1c0-e195bc62abca-cni-binary-copy\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586601 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586641 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586691 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4vq\" (UniqueName: \"kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586717 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12a7b750-341e-40b7-a425-5a452187e803-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.586766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.586718 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.601428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.601406 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzvd\" (UniqueName: \"kubernetes.io/projected/8697ef31-6a1d-4d75-a5a8-2d715991cfef-kube-api-access-lkzvd\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.602050 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602032 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnj8c\" (UniqueName: \"kubernetes.io/projected/20df0d97-58e7-42de-a1c0-e195bc62abca-kube-api-access-dnj8c\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.602212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602195 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9xq\" (UniqueName: \"kubernetes.io/projected/21a6f12f-fda5-4424-9e56-6a0ca7387aaf-kube-api-access-5h9xq\") pod \"network-check-target-2gtzn\" (UID: \"21a6f12f-fda5-4424-9e56-6a0ca7387aaf\") " pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:14.602611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602578 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvnc\" (UniqueName: \"kubernetes.io/projected/9374723a-d550-4425-9fb9-380fd3784945-kube-api-access-bjvnc\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.602857 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602839 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkrq\" (UniqueName: \"kubernetes.io/projected/a3001ced-ad94-48ad-b282-06a2a531606c-kube-api-access-vfkrq\") pod \"network-metrics-daemon-gn94r\" (UID: \"a3001ced-ad94-48ad-b282-06a2a531606c\") " pod="openshift-multus/network-metrics-daemon-gn94r" Oct 31 07:28:14.602998 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602976 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpxg\" (UniqueName: \"kubernetes.io/projected/12a7b750-341e-40b7-a425-5a452187e803-kube-api-access-blpxg\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.603030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.602988 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n2lc\" (UniqueName: \"kubernetes.io/projected/5312dbea-fea7-4156-9f54-594964546777-kube-api-access-5n2lc\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.603121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.603100 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbhz\" (UniqueName: \"kubernetes.io/projected/c115d685-21cd-4266-b6ee-49277e579096-kube-api-access-zmbhz\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.603156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.603149 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4vq\" (UniqueName: \"kubernetes.io/projected/fcca29ae-118f-4d8e-9dca-47c6f152f234-kube-api-access-6h4vq\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.603188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.603171 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qk5\" (UniqueName: \"kubernetes.io/projected/5c2a96ac-7c93-474c-a4ad-9b0091d95209-kube-api-access-x7qk5\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.687987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.687930 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.687987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.687958 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688001 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688045 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-device-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688058 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-systemd\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688080 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688101 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688105 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-modprobe-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.688117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688118 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688133 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688149 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688170 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688173 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-multus\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688185 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-cni-bin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688192 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688194 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688205 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-systemd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688217 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688235 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-log-socket\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688245 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688291 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-socket-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688236 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-dbus\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688267 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688295 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-netns\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688329 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688377 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-sys-fs\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.688394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688389 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688420 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688448 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688467 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8697ef31-6a1d-4d75-a5a8-2d715991cfef-host-slash\") pod \"iptables-alerter-86hqz\" (UID: \"8697ef31-6a1d-4d75-a5a8-2d715991cfef\") " pod="openshift-network-operator/iptables-alerter-86hqz" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688472 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688483 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-var-lib-kubelet\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688505 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-socket-dir-parent\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688507 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-kubelet\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688507 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688531 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcca29ae-118f-4d8e-9dca-47c6f152f234-hosts-file\") pod \"node-resolver-ffhvf\" (UID: \"fcca29ae-118f-4d8e-9dca-47c6f152f234\") " pod="openshift-dns/node-resolver-ffhvf" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688542 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688558 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688578 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688606 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688582 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-run\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688612 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-host\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688650 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-cnibin\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688629 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688660 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-multus-conf-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688698 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-multus-certs\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688717 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688734 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688750 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688767 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688771 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-registration-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688791 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688805 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-var-lib-kubelet\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688819 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688798 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-system-cni-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688836 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-systemd-units\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688842 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688871 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-etc-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688882 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688905 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688925 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysconfig\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688873 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-lib-modules\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688927 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688961 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-slash\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.688970 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689002 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689024 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689031 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-run-ovn\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689043 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-conf\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689047 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.689043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689002 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-sysctl-d\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689076 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-cnibin\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689079 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-system-cni-dir\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689086 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-netns\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689112 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689136 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689140 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-netd\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689155 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689182 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689208 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689228 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-sys\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689242 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12a7b750-341e-40b7-a425-5a452187e803-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxnxp\" (UID: \"12a7b750-341e-40b7-a425-5a452187e803\") " pod="openshift-multus/multus-additional-cni-plugins-cxnxp" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689231 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689296 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689288 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-node-log\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689316 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689315 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-host-run-k8s-cni-cncf-io\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689331 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689346 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-run-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689347 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689371 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-kubelet-dir\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689383 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-hostroot\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689386 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689385 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689412 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20df0d97-58e7-42de-a1c0-e195bc62abca-etc-kubernetes\") pod \"multus-qgqtb\" (UID: \"20df0d97-58e7-42de-a1c0-e195bc62abca\") " pod="openshift-multus/multus-qgqtb" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689421 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689444 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689469 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-var-lib-openvswitch\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689472 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689501 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689508 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c2a96ac-7c93-474c-a4ad-9b0091d95209-etc-kubernetes\") pod \"tuned-wjqj5\" (UID: \"5c2a96ac-7c93-474c-a4ad-9b0091d95209\") " pod="openshift-cluster-node-tuning-operator/tuned-wjqj5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689520 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9374723a-d550-4425-9fb9-380fd3784945-host-cni-bin\") pod \"ovnkube-node-p9l6j\" (UID: \"9374723a-d550-4425-9fb9-380fd3784945\") " pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689527 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689548 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/612b66f6-ebbd-40d4-87a9-3ced431e0a0f-kubelet-config\") pod \"global-pull-secret-syncer-tptr8\" (UID: \"612b66f6-ebbd-40d4-87a9-3ced431e0a0f\") " pod="kube-system/global-pull-secret-syncer-tptr8" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689581 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5312dbea-fea7-4156-9f54-594964546777-etc-selinux\") pod \"aws-ebs-csi-driver-node-86xw5\" (UID: \"5312dbea-fea7-4156-9f54-594964546777\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-86xw5" Oct 31 07:28:14.690460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:14.689161 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c115d685-21cd-4266-b6ee-49277e579096-host\") pod \"node-ca-d6ltq\" (UID: \"c115d685-21cd-4266-b6ee-49277e579096\") " pod="openshift-image-registry/node-ca-d6ltq" Oct 31 07:28:15.393877 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:15.393836 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:20.989715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:20.989686 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:24.097762 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.097726 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:24.098213 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.097956 4406 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:28:24.727224 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.727181 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz"] Oct 31 07:28:24.729896 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.729877 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:24.747048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.747018 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz"] Oct 31 07:28:24.751866 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.751847 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 31 07:28:24.757099 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.757081 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wgpnl\"" Oct 31 07:28:24.824932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.824887 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zg4dd"] Oct 31 07:28:24.827875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.827858 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:24.835940 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.835901 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-knhh4"] Oct 31 07:28:24.837687 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.837663 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/858461ce-b703-4ee4-be5e-da0a29027cea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wxdvz\" (UID: \"858461ce-b703-4ee4-be5e-da0a29027cea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:24.838539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.838522 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j44wt"] Oct 31 07:28:24.838657 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.838641 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:24.841181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.841165 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c5b95dcd-hv8rg"] Oct 31 07:28:24.841306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.841291 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:24.843825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.843809 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:28:24.843932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.843912 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.846418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.846400 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.848272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.848241 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 07:28:24.851421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.851400 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zg4dd"] Oct 31 07:28:24.852798 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.852776 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 07:28:24.852949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.852829 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vhq6\"" Oct 31 07:28:24.856966 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.856947 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zzznn"] Oct 31 07:28:24.857495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.857475 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 31 07:28:24.857783 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.857765 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 31 07:28:24.861148 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.861128 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 07:28:24.861482 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.861452 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-knhh4"] Oct 31 07:28:24.861596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.861493 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:28:24.861718 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.861633 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.862235 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.862215 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c5b95dcd-hv8rg"] Oct 31 07:28:24.865077 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.865058 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 31 07:28:24.865222 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.865087 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 31 07:28:24.865222 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.865132 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 31 07:28:24.865405 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.865186 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 07:28:24.876827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.876809 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 31 07:28:24.881419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.881397 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzznn"] Oct 31 07:28:24.881581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.881562 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j44wt"] Oct 31 07:28:24.883497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.883480 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 07:28:24.883648 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.883455 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 07:28:24.883648 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.883625 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 07:28:24.938864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.938834 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.938864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.938866 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.938893 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/858461ce-b703-4ee4-be5e-da0a29027cea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wxdvz\" (UID: \"858461ce-b703-4ee4-be5e-da0a29027cea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:24.939080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.938994 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-tls\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939027 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8bc87b9-b553-4c62-aa5b-6af07efc5981-config-volume\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:24.939080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939049 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939072 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-trusted-ca\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939115 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-installation-pull-secrets\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939156 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939199 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-image-registry-private-configuration\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939272 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjvp\" (UniqueName: \"kubernetes.io/projected/c8bc87b9-b553-4c62-aa5b-6af07efc5981-kube-api-access-hcjvp\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939294 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939332 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-certificates\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939347 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-bound-sa-token\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939364 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa469ee-3e63-4a7e-b745-3981413f85bf-data-volume\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.939376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939357 4406 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939384 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa469ee-3e63-4a7e-b745-3981413f85bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939400 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa469ee-3e63-4a7e-b745-3981413f85bf-crio-socket\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939450 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh6gj\" (UniqueName: \"kubernetes.io/projected/ce8180e3-53b2-4450-95bb-18d2ce088331-kube-api-access-fh6gj\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939491 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939513 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bc87b9-b553-4c62-aa5b-6af07efc5981-tmp-dir\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939549 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0fca3de-a6fb-4872-a908-304b0fb69f54-ca-trust-extracted\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939588 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdr2\" (UniqueName: \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939639 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8180e3-53b2-4450-95bb-18d2ce088331-cert\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939661 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939677 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8bc87b9-b553-4c62-aa5b-6af07efc5981-metrics-tls\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939695 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqktl\" (UniqueName: \"kubernetes.io/projected/36e89714-ed52-4add-b9d8-d52e2ac79a73-kube-api-access-vqktl\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:24.939712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939712 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26v77\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-kube-api-access-26v77\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:24.940097 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939849 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e89714-ed52-4add-b9d8-d52e2ac79a73-tmp\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:24.940097 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.939874 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdgk\" (UniqueName: \"kubernetes.io/projected/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-api-access-thdgk\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:24.941539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.941517 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/858461ce-b703-4ee4-be5e-da0a29027cea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wxdvz\" (UID: \"858461ce-b703-4ee4-be5e-da0a29027cea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:24.951240 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.951217 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.951930 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952155 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952278 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5wtg\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952162 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n6tqc\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952513 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-6c7ph\"" Oct 31 07:28:24.952611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952564 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 07:28:24.953048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952715 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 31 07:28:24.953048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952763 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wkhqf\"" Oct 31 07:28:24.953048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952931 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 07:28:24.953191 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.953121 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 31 07:28:24.953312 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:24.952525 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dql9j\"" Oct 31 07:28:25.040571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040488 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:25.040711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040610 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e89714-ed52-4add-b9d8-d52e2ac79a73-tmp\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:25.040711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040639 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdgk\" (UniqueName: \"kubernetes.io/projected/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-api-access-thdgk\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.040711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040657 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.040711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040676 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.040903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040821 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-tls\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.040903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040865 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8bc87b9-b553-4c62-aa5b-6af07efc5981-config-volume\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.040903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040898 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041045 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040924 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-trusted-ca\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041045 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.040979 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-installation-pull-secrets\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041045 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041014 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041054 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-image-registry-private-configuration\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041066 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e89714-ed52-4add-b9d8-d52e2ac79a73-tmp\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041087 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjvp\" (UniqueName: \"kubernetes.io/projected/c8bc87b9-b553-4c62-aa5b-6af07efc5981-kube-api-access-hcjvp\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041112 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041140 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-certificates\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041164 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-bound-sa-token\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041190 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa469ee-3e63-4a7e-b745-3981413f85bf-data-volume\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041220 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa469ee-3e63-4a7e-b745-3981413f85bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041246 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa469ee-3e63-4a7e-b745-3981413f85bf-crio-socket\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041308 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh6gj\" (UniqueName: \"kubernetes.io/projected/ce8180e3-53b2-4450-95bb-18d2ce088331-kube-api-access-fh6gj\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041338 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041360 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bc87b9-b553-4c62-aa5b-6af07efc5981-tmp-dir\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041385 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0fca3de-a6fb-4872-a908-304b0fb69f54-ca-trust-extracted\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041413 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swdr2\" (UniqueName: \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041438 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8180e3-53b2-4450-95bb-18d2ce088331-cert\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041461 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041471 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041485 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8bc87b9-b553-4c62-aa5b-6af07efc5981-metrics-tls\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041521 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqktl\" (UniqueName: \"kubernetes.io/projected/36e89714-ed52-4add-b9d8-d52e2ac79a73-kube-api-access-vqktl\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:25.041571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.041548 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26v77\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-kube-api-access-26v77\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.042217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042100 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-trusted-ca\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.042217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042202 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.042419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042392 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bc87b9-b553-4c62-aa5b-6af07efc5981-tmp-dir\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.042576 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042473 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa469ee-3e63-4a7e-b745-3981413f85bf-crio-socket\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.042576 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042498 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8bc87b9-b553-4c62-aa5b-6af07efc5981-config-volume\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.042933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042906 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0fca3de-a6fb-4872-a908-304b0fb69f54-ca-trust-extracted\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.043024 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.042986 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.043738 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.043710 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.043942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.043921 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-certificates\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.044051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.043971 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-installation-pull-secrets\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.044869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.044501 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.044869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.044812 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa469ee-3e63-4a7e-b745-3981413f85bf-data-volume\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.045019 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.044959 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.045019 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.044986 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-registry-tls\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.045311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.045291 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8bc87b9-b553-4c62-aa5b-6af07efc5981-metrics-tls\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.045662 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.045640 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa469ee-3e63-4a7e-b745-3981413f85bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.046116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.045797 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8180e3-53b2-4450-95bb-18d2ce088331-cert\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:25.046116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.046001 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0fca3de-a6fb-4872-a908-304b0fb69f54-image-registry-private-configuration\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.046323 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.046302 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.061244 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.061214 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdgk\" (UniqueName: \"kubernetes.io/projected/eaa469ee-3e63-4a7e-b745-3981413f85bf-kube-api-access-thdgk\") pod \"insights-runtime-extractor-zzznn\" (UID: \"eaa469ee-3e63-4a7e-b745-3981413f85bf\") " pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.061724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.061700 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqktl\" (UniqueName: \"kubernetes.io/projected/36e89714-ed52-4add-b9d8-d52e2ac79a73-kube-api-access-vqktl\") pod \"downloads-6dd789c8b7-knhh4\" (UID: \"36e89714-ed52-4add-b9d8-d52e2ac79a73\") " pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:25.062082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.062061 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-bound-sa-token\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.062584 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.062562 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26v77\" (UniqueName: \"kubernetes.io/projected/e0fca3de-a6fb-4872-a908-304b0fb69f54-kube-api-access-26v77\") pod \"image-registry-67c5b95dcd-hv8rg\" (UID: \"e0fca3de-a6fb-4872-a908-304b0fb69f54\") " pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.062832 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.062812 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh6gj\" (UniqueName: \"kubernetes.io/projected/ce8180e3-53b2-4450-95bb-18d2ce088331-kube-api-access-fh6gj\") pod \"ingress-canary-j44wt\" (UID: \"ce8180e3-53b2-4450-95bb-18d2ce088331\") " pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:25.063393 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.063371 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdr2\" (UniqueName: \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\") pod \"console-6bb6567fdc-xbcpn\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.064441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.064396 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjvp\" (UniqueName: \"kubernetes.io/projected/c8bc87b9-b553-4c62-aa5b-6af07efc5981-kube-api-access-hcjvp\") pod \"dns-default-zg4dd\" (UID: \"c8bc87b9-b553-4c62-aa5b-6af07efc5981\") " pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.089477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.088336 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:28:25.097749 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.097726 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.109308 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.109207 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:28:25.112632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.112605 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 31 07:28:25.142645 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.142614 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:25.151531 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.151506 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:25.157471 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.157451 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j44wt" Oct 31 07:28:25.167406 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.167385 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:25.174647 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.174495 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:25.184636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.184613 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzznn" Oct 31 07:28:25.251145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251004 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251048 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251086 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251126 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251149 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251178 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251215 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.251426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.251271 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nb4q\" (UniqueName: \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.331634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.331609 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz"] Oct 31 07:28:25.341083 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.341028 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858461ce_b703_4ee4_be5e_da0a29027cea.slice/crio-deca90a9438c635dfa19ed79d41d7b08aa53f2e58518ca7e297b2c33b51d6e12 WatchSource:0}: Error finding container deca90a9438c635dfa19ed79d41d7b08aa53f2e58518ca7e297b2c33b51d6e12: Status 404 returned error can't find the container with id deca90a9438c635dfa19ed79d41d7b08aa53f2e58518ca7e297b2c33b51d6e12 Oct 31 07:28:25.343045 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.343026 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:28:25.352208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352188 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352227 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352265 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352294 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352327 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352365 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nb4q\" (UniqueName: \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352420 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.352466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352447 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.353035 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.352985 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.353035 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.353017 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.353193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.353048 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.353193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.353170 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.353193 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.353184 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.354902 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.354876 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.354969 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.354912 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.369530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.369508 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nb4q\" (UniqueName: \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\") pod \"console-5f794974b9-lvx7v\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.413654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.413631 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:25.438301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.438276 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zg4dd"] Oct 31 07:28:25.443299 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.443275 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bc87b9_b553_4c62_aa5b_6af07efc5981.slice/crio-89899e01d1a5cd3ca7d635dd0bd483c8b811c2336f410c41e786a91b57ab70cf WatchSource:0}: Error finding container 89899e01d1a5cd3ca7d635dd0bd483c8b811c2336f410c41e786a91b57ab70cf: Status 404 returned error can't find the container with id 89899e01d1a5cd3ca7d635dd0bd483c8b811c2336f410c41e786a91b57ab70cf Oct 31 07:28:25.462415 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.461930 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-knhh4"] Oct 31 07:28:25.474153 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.474129 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e89714_ed52_4add_b9d8_d52e2ac79a73.slice/crio-5abdfd66ca4b8a4a306302494d2fa243bde0319366bd9dc77210c8f9de849455 WatchSource:0}: Error finding container 5abdfd66ca4b8a4a306302494d2fa243bde0319366bd9dc77210c8f9de849455: Status 404 returned error can't find the container with id 5abdfd66ca4b8a4a306302494d2fa243bde0319366bd9dc77210c8f9de849455 Oct 31 07:28:25.499581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.499560 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j44wt"] Oct 31 07:28:25.502918 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.502898 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c5b95dcd-hv8rg"] Oct 31 07:28:25.503911 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.503885 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8180e3_53b2_4450_95bb_18d2ce088331.slice/crio-268f722ff3960f897209b7f144e9bff80e2025f71c9dd3b609a88e3b513f72df WatchSource:0}: Error finding container 268f722ff3960f897209b7f144e9bff80e2025f71c9dd3b609a88e3b513f72df: Status 404 returned error can't find the container with id 268f722ff3960f897209b7f144e9bff80e2025f71c9dd3b609a88e3b513f72df Oct 31 07:28:25.507290 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.507266 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fca3de_a6fb_4872_a908_304b0fb69f54.slice/crio-816d5ee69b55e2d5bb2cdaf7bd3609e84fc52b412443dbf07f8efbf918daeb65 WatchSource:0}: Error finding container 816d5ee69b55e2d5bb2cdaf7bd3609e84fc52b412443dbf07f8efbf918daeb65: Status 404 returned error can't find the container with id 816d5ee69b55e2d5bb2cdaf7bd3609e84fc52b412443dbf07f8efbf918daeb65 Oct 31 07:28:25.533995 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.533970 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zg4dd" event={"ID":"c8bc87b9-b553-4c62-aa5b-6af07efc5981","Type":"ContainerStarted","Data":"89899e01d1a5cd3ca7d635dd0bd483c8b811c2336f410c41e786a91b57ab70cf"} Oct 31 07:28:25.535096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.535073 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j44wt" event={"ID":"ce8180e3-53b2-4450-95bb-18d2ce088331","Type":"ContainerStarted","Data":"268f722ff3960f897209b7f144e9bff80e2025f71c9dd3b609a88e3b513f72df"} Oct 31 07:28:25.536203 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.536181 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" event={"ID":"858461ce-b703-4ee4-be5e-da0a29027cea","Type":"ContainerStarted","Data":"deca90a9438c635dfa19ed79d41d7b08aa53f2e58518ca7e297b2c33b51d6e12"} Oct 31 07:28:25.537373 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.537315 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" event={"ID":"e0fca3de-a6fb-4872-a908-304b0fb69f54","Type":"ContainerStarted","Data":"816d5ee69b55e2d5bb2cdaf7bd3609e84fc52b412443dbf07f8efbf918daeb65"} Oct 31 07:28:25.539900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.539872 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:28:25.539900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.539970 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzznn"] Oct 31 07:28:25.543378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.543358 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-knhh4" event={"ID":"36e89714-ed52-4add-b9d8-d52e2ac79a73","Type":"ContainerStarted","Data":"5abdfd66ca4b8a4a306302494d2fa243bde0319366bd9dc77210c8f9de849455"} Oct 31 07:28:25.547281 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.547238 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa469ee_3e63_4a7e_b745_3981413f85bf.slice/crio-77a2256f9c777c071991ca7e8557a735d4420369459367acc2ae773b9fd8ab03 WatchSource:0}: Error finding container 77a2256f9c777c071991ca7e8557a735d4420369459367acc2ae773b9fd8ab03: Status 404 returned error can't find the container with id 77a2256f9c777c071991ca7e8557a735d4420369459367acc2ae773b9fd8ab03 Oct 31 07:28:25.547733 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.547670 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf60ccda_a9d2_4282_bc0c_d42895ce96eb.slice/crio-d373f8e5015dcec394113113e458c8fb186d66faf71bcfa782078fd6173ae704 WatchSource:0}: Error finding container d373f8e5015dcec394113113e458c8fb186d66faf71bcfa782078fd6173ae704: Status 404 returned error can't find the container with id d373f8e5015dcec394113113e458c8fb186d66faf71bcfa782078fd6173ae704 Oct 31 07:28:25.702511 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:25.702480 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:28:25.707209 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:25.707178 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2c7b2e_c95b_40a7_bc10_b0a7eefd3aa1.slice/crio-5bf89b81960367c21b7d864ae7d1e02786ee6a865f5ba7d76f37b27d79d6458a WatchSource:0}: Error finding container 5bf89b81960367c21b7d864ae7d1e02786ee6a865f5ba7d76f37b27d79d6458a: Status 404 returned error can't find the container with id 5bf89b81960367c21b7d864ae7d1e02786ee6a865f5ba7d76f37b27d79d6458a Oct 31 07:28:26.550372 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.550331 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f794974b9-lvx7v" event={"ID":"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1","Type":"ContainerStarted","Data":"5bf89b81960367c21b7d864ae7d1e02786ee6a865f5ba7d76f37b27d79d6458a"} Oct 31 07:28:26.552768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.552737 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb6567fdc-xbcpn" event={"ID":"df60ccda-a9d2-4282-bc0c-d42895ce96eb","Type":"ContainerStarted","Data":"d373f8e5015dcec394113113e458c8fb186d66faf71bcfa782078fd6173ae704"} Oct 31 07:28:26.555761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.555729 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" event={"ID":"e0fca3de-a6fb-4872-a908-304b0fb69f54","Type":"ContainerStarted","Data":"8b3ea5e6a8ce5eff5be9dbdae27ade8eed8bb2f1613298943c3c395bd4a7cecc"} Oct 31 07:28:26.556601 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.556532 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:26.560452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.560328 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzznn" event={"ID":"eaa469ee-3e63-4a7e-b745-3981413f85bf","Type":"ContainerStarted","Data":"4644866f83fd05866e0cee01ea627dcc96a81fa3dd337bf3d08dc509163cfebf"} Oct 31 07:28:26.560452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.560381 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzznn" event={"ID":"eaa469ee-3e63-4a7e-b745-3981413f85bf","Type":"ContainerStarted","Data":"fb8c4997d7d5c4760e439bc7dfbcb4ddc81fba88bdae89aecb162ef76509f728"} Oct 31 07:28:26.560452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:26.560409 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzznn" event={"ID":"eaa469ee-3e63-4a7e-b745-3981413f85bf","Type":"ContainerStarted","Data":"77a2256f9c777c071991ca7e8557a735d4420369459367acc2ae773b9fd8ab03"} Oct 31 07:28:27.572984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:27.572669 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" event={"ID":"858461ce-b703-4ee4-be5e-da0a29027cea","Type":"ContainerStarted","Data":"dd73644515e0a729f3cc1ee5eac3c571ff6060a65c4033b990b081acf7bacf55"} Oct 31 07:28:27.572984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:27.572737 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:27.579308 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:27.579263 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" Oct 31 07:28:27.606550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:27.606492 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" podStartSLOduration=3.606474971 podStartE2EDuration="3.606474971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:26.595837398 +0000 UTC m=+13.242836681" watchObservedRunningTime="2026-10-31 07:28:27.606474971 +0000 UTC m=+14.253474248" Oct 31 07:28:27.641451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:27.641392 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wxdvz" podStartSLOduration=2.0666965250000002 podStartE2EDuration="3.64137574s" totalImagesPullingTime="1.574679215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:27.606930815 +0000 UTC m=+14.253930100" watchObservedRunningTime="2026-10-31 07:28:27.64137574 +0000 UTC m=+14.288375019" Oct 31 07:28:28.033043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.033010 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt"] Oct 31 07:28:28.036469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.036446 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.054638 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.054579 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt"] Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.064933 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.065009 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2qpt9\"" Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.065091 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.065100 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.065189 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 31 07:28:28.065223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.065195 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 07:28:28.176632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.176343 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.176632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.176401 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjvv\" (UniqueName: \"kubernetes.io/projected/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-kube-api-access-gvjvv\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.176632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.176532 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.176943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.176704 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.277672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.277637 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.277852 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.277683 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjvv\" (UniqueName: \"kubernetes.io/projected/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-kube-api-access-gvjvv\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.277852 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.277722 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.277852 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.277766 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.279583 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.279549 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.282065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.282039 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.296525 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.296472 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjvv\" (UniqueName: \"kubernetes.io/projected/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-kube-api-access-gvjvv\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.298801 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.298776 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4edbde3c-4ca2-44e0-b3e3-ef165080af7b-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-nsqzt\" (UID: \"4edbde3c-4ca2-44e0-b3e3-ef165080af7b\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.358848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.358812 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" Oct 31 07:28:28.683989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:28.683959 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt"] Oct 31 07:28:28.693845 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:28.693815 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edbde3c_4ca2_44e0_b3e3_ef165080af7b.slice/crio-18c36dee05518f4ea329322ca9e05b3f36dddabeaa2440e2e774f2bf7932d310 WatchSource:0}: Error finding container 18c36dee05518f4ea329322ca9e05b3f36dddabeaa2440e2e774f2bf7932d310: Status 404 returned error can't find the container with id 18c36dee05518f4ea329322ca9e05b3f36dddabeaa2440e2e774f2bf7932d310 Oct 31 07:28:29.583909 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.583854 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzznn" event={"ID":"eaa469ee-3e63-4a7e-b745-3981413f85bf","Type":"ContainerStarted","Data":"d1a1b32919aa085ff8ce25e6f8f9bfb2ca4eef596e91a07e508fee0a64796b10"} Oct 31 07:28:29.586435 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.586406 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" event={"ID":"4edbde3c-4ca2-44e0-b3e3-ef165080af7b","Type":"ContainerStarted","Data":"18c36dee05518f4ea329322ca9e05b3f36dddabeaa2440e2e774f2bf7932d310"} Oct 31 07:28:29.589742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.589712 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zg4dd" event={"ID":"c8bc87b9-b553-4c62-aa5b-6af07efc5981","Type":"ContainerStarted","Data":"ddb88ab61962d0db84b6f89330f3016fcad38a8b6103624fe51a3a9e2adedefd"} Oct 31 07:28:29.589850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.589773 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zg4dd" event={"ID":"c8bc87b9-b553-4c62-aa5b-6af07efc5981","Type":"ContainerStarted","Data":"187cc37efdcb1fa15c8fc3f9614bc9d46753fafe6079a74b2e194a03902d8f1a"} Oct 31 07:28:29.589850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.589821 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:29.631921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.631868 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zzznn" podStartSLOduration=2.109074144 podStartE2EDuration="5.63185476s" totalImagesPullingTime="3.522780616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:29.620782253 +0000 UTC m=+16.267781540" watchObservedRunningTime="2026-10-31 07:28:29.63185476 +0000 UTC m=+16.278854047" Oct 31 07:28:29.655722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:29.655666 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-zg4dd" podStartSLOduration=2.522962691 podStartE2EDuration="5.655652704s" totalImagesPullingTime="3.132690013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:29.655366475 +0000 UTC m=+16.302365756" watchObservedRunningTime="2026-10-31 07:28:29.655652704 +0000 UTC m=+16.302651979" Oct 31 07:28:30.598007 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:30.597937 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" event={"ID":"4edbde3c-4ca2-44e0-b3e3-ef165080af7b","Type":"ContainerStarted","Data":"895da448c27a1097935bc1c116743ea2b56b57460af8106a9967175881c466f6"} Oct 31 07:28:30.601207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:30.601179 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j44wt" event={"ID":"ce8180e3-53b2-4450-95bb-18d2ce088331","Type":"ContainerStarted","Data":"e4b418d3cb7df0274839a83785842130b393a92368fc0cc116a1ca84cce78306"} Oct 31 07:28:30.640876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:30.640818 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j44wt" podStartSLOduration=1.9184124869999999 podStartE2EDuration="6.640805042s" totalImagesPullingTime="4.722392555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:30.640608952 +0000 UTC m=+17.287608234" watchObservedRunningTime="2026-10-31 07:28:30.640805042 +0000 UTC m=+17.287804327" Oct 31 07:28:31.606438 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.606398 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" event={"ID":"4edbde3c-4ca2-44e0-b3e3-ef165080af7b","Type":"ContainerStarted","Data":"497d95b410aa208e3d9f8c755caf8196c7c43a34eca4df5933cc450a60d72168"} Oct 31 07:28:31.608186 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.608153 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f794974b9-lvx7v" event={"ID":"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1","Type":"ContainerStarted","Data":"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5"} Oct 31 07:28:31.609861 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.609829 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb6567fdc-xbcpn" event={"ID":"df60ccda-a9d2-4282-bc0c-d42895ce96eb","Type":"ContainerStarted","Data":"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29"} Oct 31 07:28:31.641926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.641869 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-nsqzt" podStartSLOduration=1.8263294079999999 podStartE2EDuration="3.641844912s" totalImagesPullingTime="1.815515504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:31.640717249 +0000 UTC m=+18.287716530" watchObservedRunningTime="2026-10-31 07:28:31.641844912 +0000 UTC m=+18.288844194" Oct 31 07:28:31.679271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.679171 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6bb6567fdc-xbcpn" podStartSLOduration=2.059499449 podStartE2EDuration="7.679156225s" totalImagesPullingTime="5.619656776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:31.678474327 +0000 UTC m=+18.325473611" watchObservedRunningTime="2026-10-31 07:28:31.679156225 +0000 UTC m=+18.326155506" Oct 31 07:28:31.713223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:31.713180 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5f794974b9-lvx7v" podStartSLOduration=1.444057776 podStartE2EDuration="6.713167854s" totalImagesPullingTime="5.269110078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:31.713105204 +0000 UTC m=+18.360104508" watchObservedRunningTime="2026-10-31 07:28:31.713167854 +0000 UTC m=+18.360167135" Oct 31 07:28:32.503200 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:32.503172 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p9l6j" Oct 31 07:28:33.666853 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.666818 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bsfxh"] Oct 31 07:28:33.670904 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.670879 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.723154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.723119 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 31 07:28:33.723319 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.723208 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 31 07:28:33.723379 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.723343 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ppvgk\"" Oct 31 07:28:33.723443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.723384 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 31 07:28:33.824015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.823975 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-wtmp\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824189 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824029 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-tls\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824189 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824157 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dzlw\" (UniqueName: \"kubernetes.io/projected/8cc1705e-fa3a-4172-b17f-5c639e1e0750-kube-api-access-9dzlw\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824194 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-textfile\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824290 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-root\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824319 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-metrics-client-ca\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824346 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824409 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-sys\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.824476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.824431 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.925820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925745 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-sys\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.925820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925782 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925824 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-wtmp\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925853 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-tls\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925886 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dzlw\" (UniqueName: \"kubernetes.io/projected/8cc1705e-fa3a-4172-b17f-5c639e1e0750-kube-api-access-9dzlw\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925907 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-textfile\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925930 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-root\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925950 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-wtmp\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.925954 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-metrics-client-ca\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926011 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926535 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926509 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-root\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926554 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-metrics-client-ca\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926570 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc1705e-fa3a-4172-b17f-5c639e1e0750-sys\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926600 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.926746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.926616 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-textfile\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.928508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.928484 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.928794 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.928774 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cc1705e-fa3a-4172-b17f-5c639e1e0750-node-exporter-tls\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.943794 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.943703 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dzlw\" (UniqueName: \"kubernetes.io/projected/8cc1705e-fa3a-4172-b17f-5c639e1e0750-kube-api-access-9dzlw\") pod \"node-exporter-bsfxh\" (UID: \"8cc1705e-fa3a-4172-b17f-5c639e1e0750\") " pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:33.987640 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:33.987609 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsfxh" Oct 31 07:28:34.000832 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:34.000801 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc1705e_fa3a_4172_b17f_5c639e1e0750.slice/crio-a4cab15c874a229c6d181a8bb4484a6d3cf9d648440fd9d9ca9018ecbcccbe58 WatchSource:0}: Error finding container a4cab15c874a229c6d181a8bb4484a6d3cf9d648440fd9d9ca9018ecbcccbe58: Status 404 returned error can't find the container with id a4cab15c874a229c6d181a8bb4484a6d3cf9d648440fd9d9ca9018ecbcccbe58 Oct 31 07:28:34.622422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:34.622381 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsfxh" event={"ID":"8cc1705e-fa3a-4172-b17f-5c639e1e0750","Type":"ContainerStarted","Data":"a4cab15c874a229c6d181a8bb4484a6d3cf9d648440fd9d9ca9018ecbcccbe58"} Oct 31 07:28:35.175093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.175059 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:35.175516 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.175127 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:35.181367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.181338 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:35.414526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.414489 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:35.414711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.414563 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:35.420081 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.420058 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:35.629158 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.629123 4406 generic.go:356] "Generic (PLEG): container finished" podID="8cc1705e-fa3a-4172-b17f-5c639e1e0750" containerID="a495270c0a7fd5d79c942ebd0da7e9dc5dfe2906e28c103fa4c4680591128184" exitCode=0 Oct 31 07:28:35.629332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.629221 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsfxh" event={"ID":"8cc1705e-fa3a-4172-b17f-5c639e1e0750","Type":"ContainerDied","Data":"a495270c0a7fd5d79c942ebd0da7e9dc5dfe2906e28c103fa4c4680591128184"} Oct 31 07:28:35.634318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.634295 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:28:35.635184 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.635164 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:28:35.773320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.773289 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:28:35.901475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:35.901443 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nlstp" Oct 31 07:28:36.635044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:36.635001 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsfxh" event={"ID":"8cc1705e-fa3a-4172-b17f-5c639e1e0750","Type":"ContainerStarted","Data":"6ba8e6191b31e904bd70740bf000aea0ff5470e5b2ea730d99ee4da6cb5b9b71"} Oct 31 07:28:36.635651 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:36.635074 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsfxh" event={"ID":"8cc1705e-fa3a-4172-b17f-5c639e1e0750","Type":"ContainerStarted","Data":"0a82dbd052b176526038c2a00e74035520347391653278699c24118c433fb600"} Oct 31 07:28:36.698130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:36.698081 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bsfxh" podStartSLOduration=2.574615569 podStartE2EDuration="3.698067487s" totalImagesPullingTime="1.044793788s" totalInitContainerRuntime="78.65813ms" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:36.687322491 +0000 UTC m=+23.334321772" watchObservedRunningTime="2026-10-31 07:28:36.698067487 +0000 UTC m=+23.345066767" Oct 31 07:28:39.603059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:39.603029 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zg4dd" Oct 31 07:28:39.996649 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:28:39.996564 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:28:44.315539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.315510 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:28:44.337496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.337471 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.339576 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.339550 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:28:44.523886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.523857 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.523891 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.523914 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.524099 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524171 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.524143 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x7f\" (UniqueName: \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.524195 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524243 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.524223 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.524311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.524298 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625592 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625562 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625726 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625624 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625726 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625650 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625726 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625682 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625726 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625721 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625859 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x7f\" (UniqueName: \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.625922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625907 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626029 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.625941 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626134 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.626106 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.626431 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.626603 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626710 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.626686 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.626771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.626710 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.628223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.628197 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.628399 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.628383 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.643986 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.643963 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x7f\" (UniqueName: \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\") pod \"console-64856c4c5-5zhcm\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.658695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.658674 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:44.662780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.662760 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-knhh4" event={"ID":"36e89714-ed52-4add-b9d8-d52e2ac79a73","Type":"ContainerStarted","Data":"3e6869d4f8864effdbe51d52e13ef6a2720cbe8ace61561727daf91abb30244d"} Oct 31 07:28:44.662972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.662956 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:44.664090 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.664069 4406 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-knhh4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.8:8080/\": dial tcp 10.133.0.8:8080: connect: connection refused" start-of-body= Oct 31 07:28:44.664169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.664105 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-knhh4" podUID="36e89714-ed52-4add-b9d8-d52e2ac79a73" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.8:8080/\": dial tcp 10.133.0.8:8080: connect: connection refused" Oct 31 07:28:44.697525 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.697471 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-knhh4" podStartSLOduration=1.674827413 podStartE2EDuration="20.697453293s" totalImagesPullingTime="19.02262588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:44.697092278 +0000 UTC m=+31.344091558" watchObservedRunningTime="2026-10-31 07:28:44.697453293 +0000 UTC m=+31.344452575" Oct 31 07:28:44.977751 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:44.977671 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:28:44.987795 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:28:44.987745 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3944cfbe_ea24_40d8_ad9c_67eb40672e32.slice/crio-df763821133d5d04d5ca5c2335cf2fa12fd39af01f9aaa9006f4fb958f91abaa WatchSource:0}: Error finding container df763821133d5d04d5ca5c2335cf2fa12fd39af01f9aaa9006f4fb958f91abaa: Status 404 returned error can't find the container with id df763821133d5d04d5ca5c2335cf2fa12fd39af01f9aaa9006f4fb958f91abaa Oct 31 07:28:45.512527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:45.512494 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2gtzn" Oct 31 07:28:45.668864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:45.668809 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64856c4c5-5zhcm" event={"ID":"3944cfbe-ea24-40d8-ad9c-67eb40672e32","Type":"ContainerStarted","Data":"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a"} Oct 31 07:28:45.669048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:45.668883 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64856c4c5-5zhcm" event={"ID":"3944cfbe-ea24-40d8-ad9c-67eb40672e32","Type":"ContainerStarted","Data":"df763821133d5d04d5ca5c2335cf2fa12fd39af01f9aaa9006f4fb958f91abaa"} Oct 31 07:28:45.672058 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:45.672030 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-knhh4" Oct 31 07:28:45.708316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:45.708244 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-64856c4c5-5zhcm" podStartSLOduration=1.708229338 podStartE2EDuration="1.708229338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:45.708217464 +0000 UTC m=+32.355216746" watchObservedRunningTime="2026-10-31 07:28:45.708229338 +0000 UTC m=+32.355228620" Oct 31 07:28:48.583080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:48.583049 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67c5b95dcd-hv8rg" Oct 31 07:28:54.659392 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:54.659361 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:54.659902 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:54.659451 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:54.664369 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:54.664345 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:54.706273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:54.706239 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:28:54.770626 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:28:54.770600 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:29:02.659375 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.659243 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6bb6567fdc-xbcpn" podUID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" containerName="console" containerID="cri-o://87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29" gracePeriod=15 Oct 31 07:29:02.935664 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.935605 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:29:02.956999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.956973 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957023 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957070 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957100 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\" (UniqueName: \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957141 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\" (UniqueName: \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957165 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957193 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\") pod \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\" (UID: \"df60ccda-a9d2-4282-bc0c-d42895ce96eb\") " Oct 31 07:29:02.957580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957506 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:29:02.957580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957566 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:02.957730 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957611 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:02.957730 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.957655 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:02.959286 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.959245 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:29:02.959584 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.959565 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:29:02.959652 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:02.959594 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2" pod "df60ccda-a9d2-4282-bc0c-d42895ce96eb" (UID: "df60ccda-a9d2-4282-bc0c-d42895ce96eb"). InnerVolumeSpecName "kube-api-access-swdr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:29:03.058545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058514 4406 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-oauth-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058541 4406 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df60ccda-a9d2-4282-bc0c-d42895ce96eb-tmp\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058551 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swdr2\" (UniqueName: \"kubernetes.io/projected/df60ccda-a9d2-4282-bc0c-d42895ce96eb-kube-api-access-swdr2\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058561 4406 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058569 4406 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-oauth-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058577 4406 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.058750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.058586 4406 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df60ccda-a9d2-4282-bc0c-d42895ce96eb-console-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:03.734120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.734032 4406 generic.go:356] "Generic (PLEG): container finished" podID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" containerID="87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29" exitCode=0 Oct 31 07:29:03.734120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.734090 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb6567fdc-xbcpn" event={"ID":"df60ccda-a9d2-4282-bc0c-d42895ce96eb","Type":"ContainerDied","Data":"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29"} Oct 31 07:29:03.734120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.734096 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb6567fdc-xbcpn" Oct 31 07:29:03.734742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.734160 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb6567fdc-xbcpn" event={"ID":"df60ccda-a9d2-4282-bc0c-d42895ce96eb","Type":"ContainerDied","Data":"d373f8e5015dcec394113113e458c8fb186d66faf71bcfa782078fd6173ae704"} Oct 31 07:29:03.734742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.734183 4406 scope.go:122] "RemoveContainer" containerID="87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29" Oct 31 07:29:03.752735 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.752712 4406 scope.go:122] "RemoveContainer" containerID="87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29" Oct 31 07:29:03.753019 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:29:03.752997 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29\": container with ID starting with 87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29 not found: ID does not exist" containerID="87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29" Oct 31 07:29:03.753094 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.753031 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29"} err="failed to get container status \"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29\": rpc error: code = NotFound desc = could not find container \"87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29\": container with ID starting with 87df5aeb96250b81ec3ae707d4c19fd61e1b913bb550807cb06b69b860cfce29 not found: ID does not exist" Oct 31 07:29:03.777232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.777206 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:29:03.787876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:03.787853 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bb6567fdc-xbcpn"] Oct 31 07:29:05.474397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:05.474362 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" path="/var/lib/kubelet/pods/df60ccda-a9d2-4282-bc0c-d42895ce96eb/volumes" Oct 31 07:29:09.990316 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:29:09.990284 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:29:19.789806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:19.789746 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5f794974b9-lvx7v" podUID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" containerName="console" containerID="cri-o://5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5" gracePeriod=15 Oct 31 07:29:20.075167 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.075140 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:29:20.188517 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188476 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188517 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188521 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188549 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188605 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\" (UniqueName: \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188637 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188668 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188697 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.188811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188778 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\") pod \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\" (UID: \"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1\") " Oct 31 07:29:20.189114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188885 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:29:20.189114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.188894 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:20.189114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.189043 4406 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.189114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.189066 4406 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-tmp\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.189322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.189166 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:20.189322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.189228 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:20.189421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.189322 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:29:20.190958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.190935 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:29:20.191059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.190982 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:29:20.191059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.191001 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q" pod "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" (UID: "9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1"). InnerVolumeSpecName "kube-api-access-8nb4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:29:20.290169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290137 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nb4q\" (UniqueName: \"kubernetes.io/projected/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-kube-api-access-8nb4q\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.290169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290162 4406 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-oauth-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.290169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290173 4406 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-oauth-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.290410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290181 4406 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.290410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290190 4406 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-console-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.290410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.290198 4406 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1-trusted-ca-bundle\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:29:20.789513 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.789476 4406 generic.go:356] "Generic (PLEG): container finished" podID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" containerID="5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5" exitCode=0 Oct 31 07:29:20.789743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.789529 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f794974b9-lvx7v" Oct 31 07:29:20.789743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.789554 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f794974b9-lvx7v" event={"ID":"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1","Type":"ContainerDied","Data":"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5"} Oct 31 07:29:20.789743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.789601 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f794974b9-lvx7v" event={"ID":"9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1","Type":"ContainerDied","Data":"5bf89b81960367c21b7d864ae7d1e02786ee6a865f5ba7d76f37b27d79d6458a"} Oct 31 07:29:20.789743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.789622 4406 scope.go:122] "RemoveContainer" containerID="5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5" Oct 31 07:29:20.802523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.802500 4406 scope.go:122] "RemoveContainer" containerID="5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5" Oct 31 07:29:20.802805 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:29:20.802781 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5\": container with ID starting with 5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5 not found: ID does not exist" containerID="5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5" Oct 31 07:29:20.802854 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.802816 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5"} err="failed to get container status \"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5\": rpc error: code = NotFound desc = could not find container \"5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5\": container with ID starting with 5ab9c12dbbec735071dbc61f3922c50f5c98e0c99b13e95c1f6be1fdc567b5e5 not found: ID does not exist" Oct 31 07:29:20.833747 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.833723 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:29:20.844409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:20.844383 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f794974b9-lvx7v"] Oct 31 07:29:21.474491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:21.474456 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" path="/var/lib/kubelet/pods/9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1/volumes" Oct 31 07:29:31.401393 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401362 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401596 4406 cpu_manager.go:414] "containerMap: removing container" podUID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" containerName="console" Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401608 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" containerName="console" Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401628 4406 cpu_manager.go:414] "containerMap: removing container" podUID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" containerName="console" Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401633 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" containerName="console" Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401679 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c2c7b2e-c95b-40a7-bc10-b0a7eefd3aa1" containerName="console" Oct 31 07:29:31.401788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.401688 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="df60ccda-a9d2-4282-bc0c-d42895ce96eb" containerName="console" Oct 31 07:29:31.414781 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.414760 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.423194 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.423165 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:29:31.575408 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575370 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575408 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575407 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575435 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575555 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575602 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575659 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575689 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.575782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.575747 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx22c\" (UniqueName: \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.676855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676777 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.676855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676817 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.676855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676838 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676866 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676886 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676909 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx22c\" (UniqueName: \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676937 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.676953 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.677743 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.677760 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.677743 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.677831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.677812 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.678342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.678319 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.679236 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.679219 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.679659 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.679642 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.693987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.693961 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx22c\" (UniqueName: \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\") pod \"console-9666bc768-zsn94\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:31.741798 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:31.741770 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:32.060827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:32.060752 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:29:32.065188 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:29:32.065160 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed5e9b1_b1aa_4f9a_ae53_50bf5bb01ab5.slice/crio-4567cbb93c54df2181bb625b088cf60919fb97a0620e2e0a1c54533924c05ffd WatchSource:0}: Error finding container 4567cbb93c54df2181bb625b088cf60919fb97a0620e2e0a1c54533924c05ffd: Status 404 returned error can't find the container with id 4567cbb93c54df2181bb625b088cf60919fb97a0620e2e0a1c54533924c05ffd Oct 31 07:29:32.830930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:32.830897 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9666bc768-zsn94" event={"ID":"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5","Type":"ContainerStarted","Data":"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa"} Oct 31 07:29:32.831343 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:32.830949 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9666bc768-zsn94" event={"ID":"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5","Type":"ContainerStarted","Data":"4567cbb93c54df2181bb625b088cf60919fb97a0620e2e0a1c54533924c05ffd"} Oct 31 07:29:32.865824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:32.865767 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-9666bc768-zsn94" podStartSLOduration=1.865752513 podStartE2EDuration="1.865752513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:32.865212893 +0000 UTC m=+79.512212185" watchObservedRunningTime="2026-10-31 07:29:32.865752513 +0000 UTC m=+79.512751794" Oct 31 07:29:39.989883 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:29:39.989852 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:29:41.741876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:41.741837 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:41.742413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:41.741901 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:41.746777 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:41.746753 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:41.865945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:41.865919 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:29:41.930126 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:41.930093 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:29:42.064552 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.064478 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7867f5f669-j4fzd"] Oct 31 07:29:42.068397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.068376 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.085735 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.085715 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7867f5f669-j4fzd"] Oct 31 07:29:42.259470 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259436 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259470 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259475 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-oauth-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259514 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-service-ca\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259589 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-trusted-ca-bundle\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259630 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259653 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9gv\" (UniqueName: \"kubernetes.io/projected/b8f6c3f4-450b-48ec-81c3-311eafd511eb-kube-api-access-5z9gv\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259676 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f6c3f4-450b-48ec-81c3-311eafd511eb-tmp\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.259833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.259693 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-oauth-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360402 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-trusted-ca-bundle\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360456 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360659 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360586 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9gv\" (UniqueName: \"kubernetes.io/projected/b8f6c3f4-450b-48ec-81c3-311eafd511eb-kube-api-access-5z9gv\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360659 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360652 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f6c3f4-450b-48ec-81c3-311eafd511eb-tmp\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360680 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-oauth-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360767 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360737 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360768 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-oauth-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.360855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.360813 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-service-ca\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.361036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.361015 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f6c3f4-450b-48ec-81c3-311eafd511eb-tmp\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.361186 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.361168 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.361506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.361483 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-service-ca\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.361617 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.361520 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-trusted-ca-bundle\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.361617 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.361532 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8f6c3f4-450b-48ec-81c3-311eafd511eb-oauth-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.363377 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.363357 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-serving-cert\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.363485 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.363466 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8f6c3f4-450b-48ec-81c3-311eafd511eb-console-oauth-config\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.377843 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.377816 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9gv\" (UniqueName: \"kubernetes.io/projected/b8f6c3f4-450b-48ec-81c3-311eafd511eb-kube-api-access-5z9gv\") pod \"console-7867f5f669-j4fzd\" (UID: \"b8f6c3f4-450b-48ec-81c3-311eafd511eb\") " pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.379649 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.379633 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:42.671301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.671208 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7867f5f669-j4fzd"] Oct 31 07:29:42.676066 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:29:42.676038 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f6c3f4_450b_48ec_81c3_311eafd511eb.slice/crio-f228d8f6bb39a945425f139ead856ed245c3c7ecaa4d90a2afb45ee5e2aa60cf WatchSource:0}: Error finding container f228d8f6bb39a945425f139ead856ed245c3c7ecaa4d90a2afb45ee5e2aa60cf: Status 404 returned error can't find the container with id f228d8f6bb39a945425f139ead856ed245c3c7ecaa4d90a2afb45ee5e2aa60cf Oct 31 07:29:42.867007 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.866962 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867f5f669-j4fzd" event={"ID":"b8f6c3f4-450b-48ec-81c3-311eafd511eb","Type":"ContainerStarted","Data":"9e1b7a6d5961f8770b2d1d4b4e23f6c30f8fc12fd2a2d580674eb6cb44523b43"} Oct 31 07:29:42.867407 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.867023 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867f5f669-j4fzd" event={"ID":"b8f6c3f4-450b-48ec-81c3-311eafd511eb","Type":"ContainerStarted","Data":"f228d8f6bb39a945425f139ead856ed245c3c7ecaa4d90a2afb45ee5e2aa60cf"} Oct 31 07:29:42.912708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:42.912659 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7867f5f669-j4fzd" podStartSLOduration=0.912646166 podStartE2EDuration="912.646166ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:29:42.901758836 +0000 UTC m=+89.548758116" watchObservedRunningTime="2026-10-31 07:29:42.912646166 +0000 UTC m=+89.559645447" Oct 31 07:29:52.380750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:52.380714 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:52.381166 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:52.380764 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:52.385658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:52.385636 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:52.902316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:52.902234 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7867f5f669-j4fzd" Oct 31 07:29:52.966580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:29:52.966544 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:30:06.949229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:06.949193 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-64856c4c5-5zhcm" podUID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" containerName="console" containerID="cri-o://90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a" gracePeriod=15 Oct 31 07:30:07.183088 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.183063 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:30:07.235541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235460 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235515 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\" (UniqueName: \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235544 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235580 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235639 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235667 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.235760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235692 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.236033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.235877 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\") pod \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\" (UID: \"3944cfbe-ea24-40d8-ad9c-67eb40672e32\") " Oct 31 07:30:07.236105 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236075 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:07.236215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236181 4406 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.236361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236232 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:30:07.236428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236380 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:07.236428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236390 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:07.236428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.236395 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:07.237802 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.237768 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "kube-api-access-j4x7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:30:07.237899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.237798 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:30:07.238048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.238028 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert" pod "3944cfbe-ea24-40d8-ad9c-67eb40672e32" (UID: "3944cfbe-ea24-40d8-ad9c-67eb40672e32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:30:07.336511 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336480 4406 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3944cfbe-ea24-40d8-ad9c-67eb40672e32-tmp\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336511 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336507 4406 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-trusted-ca-bundle\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336511 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336518 4406 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336529 4406 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336538 4406 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3944cfbe-ea24-40d8-ad9c-67eb40672e32-oauth-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336546 4406 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3944cfbe-ea24-40d8-ad9c-67eb40672e32-console-oauth-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.336723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.336555 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4x7f\" (UniqueName: \"kubernetes.io/projected/3944cfbe-ea24-40d8-ad9c-67eb40672e32-kube-api-access-j4x7f\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:07.946471 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.946432 4406 generic.go:356] "Generic (PLEG): container finished" podID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" containerID="90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a" exitCode=0 Oct 31 07:30:07.946643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.946480 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64856c4c5-5zhcm" event={"ID":"3944cfbe-ea24-40d8-ad9c-67eb40672e32","Type":"ContainerDied","Data":"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a"} Oct 31 07:30:07.946643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.946502 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64856c4c5-5zhcm" Oct 31 07:30:07.946643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.946530 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64856c4c5-5zhcm" event={"ID":"3944cfbe-ea24-40d8-ad9c-67eb40672e32","Type":"ContainerDied","Data":"df763821133d5d04d5ca5c2335cf2fa12fd39af01f9aaa9006f4fb958f91abaa"} Oct 31 07:30:07.946643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.946555 4406 scope.go:122] "RemoveContainer" containerID="90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a" Oct 31 07:30:07.954227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.954023 4406 scope.go:122] "RemoveContainer" containerID="90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a" Oct 31 07:30:07.954484 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:30:07.954324 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a\": container with ID starting with 90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a not found: ID does not exist" containerID="90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a" Oct 31 07:30:07.954484 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.954359 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a"} err="failed to get container status \"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a\": rpc error: code = NotFound desc = could not find container \"90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a\": container with ID starting with 90c4430d628d111fc5285c5caac9555aeda3049eeeee05516b7c9d2ace56d80a not found: ID does not exist" Oct 31 07:30:07.991930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:07.991889 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:30:08.002442 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:08.002417 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64856c4c5-5zhcm"] Oct 31 07:30:09.474419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:09.474383 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" path="/var/lib/kubelet/pods/3944cfbe-ea24-40d8-ad9c-67eb40672e32/volumes" Oct 31 07:30:09.990328 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:30:09.990291 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:30:17.985530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:17.985469 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-9666bc768-zsn94" podUID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" containerName="console" containerID="cri-o://d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa" gracePeriod=15 Oct 31 07:30:18.219373 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.219349 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:30:18.315422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315347 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315380 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315399 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315432 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315475 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315533 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315586 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315617 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\" (UniqueName: \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\") pod \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\" (UID: \"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5\") " Oct 31 07:30:18.315944 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315786 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:18.315999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315908 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:30:18.315999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.315795 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:18.316145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.316115 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:18.316145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.316127 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:30:18.317558 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.317537 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:30:18.317642 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.317630 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "kube-api-access-wx22c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:30:18.317725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.317709 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert" pod "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" (UID: "6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:30:18.416527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416499 4406 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416523 4406 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-tmp\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416533 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx22c\" (UniqueName: \"kubernetes.io/projected/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-kube-api-access-wx22c\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416543 4406 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416551 4406 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-console-oauth-config\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416559 4406 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416567 4406 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-trusted-ca-bundle\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.416712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.416575 4406 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5-oauth-serving-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:30:18.983480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.983451 4406 generic.go:356] "Generic (PLEG): container finished" podID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" containerID="d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa" exitCode=0 Oct 31 07:30:18.983655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.983493 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9666bc768-zsn94" event={"ID":"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5","Type":"ContainerDied","Data":"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa"} Oct 31 07:30:18.983655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.983496 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9666bc768-zsn94" Oct 31 07:30:18.983655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.983532 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9666bc768-zsn94" event={"ID":"6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5","Type":"ContainerDied","Data":"4567cbb93c54df2181bb625b088cf60919fb97a0620e2e0a1c54533924c05ffd"} Oct 31 07:30:18.983655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.983553 4406 scope.go:122] "RemoveContainer" containerID="d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa" Oct 31 07:30:18.991999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.991788 4406 scope.go:122] "RemoveContainer" containerID="d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa" Oct 31 07:30:18.992272 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:30:18.992093 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa\": container with ID starting with d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa not found: ID does not exist" containerID="d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa" Oct 31 07:30:18.992272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:18.992122 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa"} err="failed to get container status \"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa\": rpc error: code = NotFound desc = could not find container \"d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa\": container with ID starting with d77bfc74734cb6bf9c3d25c8cefeeeb78ba0d76c179d58ad6b75f43e7688aefa not found: ID does not exist" Oct 31 07:30:19.027234 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:19.027204 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:30:19.037730 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:19.037706 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9666bc768-zsn94"] Oct 31 07:30:19.474169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:30:19.474142 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" path="/var/lib/kubelet/pods/6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5/volumes" Oct 31 07:30:39.990432 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:30:39.990393 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:31:09.990201 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:31:09.990164 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:31:39.990703 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:31:39.990662 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:32:09.990859 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:32:09.990783 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:32:19.679869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.679834 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82"] Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680075 4406 cpu_manager.go:414] "containerMap: removing container" podUID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" containerName="console" Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680084 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" containerName="console" Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680093 4406 cpu_manager.go:414] "containerMap: removing container" podUID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" containerName="console" Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680098 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" containerName="console" Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680143 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ed5e9b1-b1aa-4f9a-ae53-50bf5bb01ab5" containerName="console" Oct 31 07:32:19.680450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.680149 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="3944cfbe-ea24-40d8-ad9c-67eb40672e32" containerName="console" Oct 31 07:32:19.683211 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.683191 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.706786 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.706760 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 31 07:32:19.706903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.706887 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 31 07:32:19.706962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.706919 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-d6wbd\"" Oct 31 07:32:19.714487 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.714467 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82"] Oct 31 07:32:19.838224 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.838189 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.838419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.838225 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6pv\" (UniqueName: \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.838419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.838361 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.939550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.939479 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.939550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.939545 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.939710 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.939566 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6pv\" (UniqueName: \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.939897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.939871 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.939975 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.939925 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.957943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.957912 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6pv\" (UniqueName: \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:19.998863 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:19.998833 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:20.151279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.151223 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:32:20.154950 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.154923 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.169949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.169925 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:32:20.179715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179690 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 31 07:32:20.179715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179690 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 31 07:32:20.179938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179719 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 31 07:32:20.179938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179760 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 31 07:32:20.179938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179780 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 31 07:32:20.179938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179799 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 31 07:32:20.179938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.179802 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jbt7z\"" Oct 31 07:32:20.241918 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.241851 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.241918 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.241881 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.242075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.241917 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcl6g\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.242075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.241991 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.242075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.242011 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.242075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.242034 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.242075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.242052 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.287319 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.287295 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82"] Oct 31 07:32:20.291780 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:32:20.291743 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb4c9ec_22e5_42a5_8006_39f7acbc195a.slice/crio-51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189 WatchSource:0}: Error finding container 51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189: Status 404 returned error can't find the container with id 51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189 Oct 31 07:32:20.342888 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.342865 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.342991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.342896 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.342991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.342928 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcl6g\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.342991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.342960 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.342991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.342985 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.343209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.343017 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.343209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.343142 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.343708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.343688 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.345278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.345238 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.345387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.345326 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.345478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.345460 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.345529 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.345490 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.360285 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.360265 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.360480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.360463 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcl6g\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\") pod \"istiod-openshift-gateway-7876bfcb74-hh8bs\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.372900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.372874 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" event={"ID":"4bb4c9ec-22e5-42a5-8006-39f7acbc195a","Type":"ContainerStarted","Data":"51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189"} Oct 31 07:32:20.465520 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.465492 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:20.769070 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:20.768986 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:32:20.774187 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:32:20.774156 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886ad99d_4519_43ab_af12_54f78264dd57.slice/crio-0b62cf099d08d8f4a5a4b2d80b379a417483aeb5703df2e7a11e8b476bf624fa WatchSource:0}: Error finding container 0b62cf099d08d8f4a5a4b2d80b379a417483aeb5703df2e7a11e8b476bf624fa: Status 404 returned error can't find the container with id 0b62cf099d08d8f4a5a4b2d80b379a417483aeb5703df2e7a11e8b476bf624fa Oct 31 07:32:21.378020 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:21.377981 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" event={"ID":"886ad99d-4519-43ab-af12-54f78264dd57","Type":"ContainerStarted","Data":"0b62cf099d08d8f4a5a4b2d80b379a417483aeb5703df2e7a11e8b476bf624fa"} Oct 31 07:32:23.735919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:23.735885 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:32:23.736317 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:23.735959 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:32:24.393158 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:24.393123 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" event={"ID":"886ad99d-4519-43ab-af12-54f78264dd57","Type":"ContainerStarted","Data":"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8"} Oct 31 07:32:24.393958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:24.393412 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:24.395453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:24.395281 4406 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-hh8bs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:32:24.395697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:24.395406 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" podUID="886ad99d-4519-43ab-af12-54f78264dd57" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:32:24.459164 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:24.459091 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" podStartSLOduration=1.500382367 podStartE2EDuration="4.459075317s" totalImagesPullingTime="2.95869295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:24.448442101 +0000 UTC m=+251.095441383" watchObservedRunningTime="2026-10-31 07:32:24.459075317 +0000 UTC m=+251.106074598" Oct 31 07:32:25.397709 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:25.397679 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:32:26.401613 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:26.401578 4406 generic.go:356] "Generic (PLEG): container finished" podID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerID="7381f5785116c08969d4a9ec9d1f6ce2160189477b1981f4bb5d42912c12faa1" exitCode=0 Oct 31 07:32:26.401920 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:26.401669 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" event={"ID":"4bb4c9ec-22e5-42a5-8006-39f7acbc195a","Type":"ContainerDied","Data":"7381f5785116c08969d4a9ec9d1f6ce2160189477b1981f4bb5d42912c12faa1"} Oct 31 07:32:28.411656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:28.411622 4406 generic.go:356] "Generic (PLEG): container finished" podID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerID="91cb2399121cfca20bb3d82aad255e84e54966eb7c97e82a7b388552872f437f" exitCode=0 Oct 31 07:32:28.412032 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:28.411669 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" event={"ID":"4bb4c9ec-22e5-42a5-8006-39f7acbc195a","Type":"ContainerDied","Data":"91cb2399121cfca20bb3d82aad255e84e54966eb7c97e82a7b388552872f437f"} Oct 31 07:32:34.433841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:34.433761 4406 generic.go:356] "Generic (PLEG): container finished" podID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerID="4fd4a0890896ea7d16a34203f73591a1abcf2af64a15f4015939d324fbbe3baa" exitCode=0 Oct 31 07:32:34.433841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:34.433812 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" event={"ID":"4bb4c9ec-22e5-42a5-8006-39f7acbc195a","Type":"ContainerDied","Data":"4fd4a0890896ea7d16a34203f73591a1abcf2af64a15f4015939d324fbbe3baa"} Oct 31 07:32:35.561573 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.561548 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:35.566733 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.566715 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\") pod \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " Oct 31 07:32:35.566796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.566772 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\") pod \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " Oct 31 07:32:35.566796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.566791 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\" (UniqueName: \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\") pod \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\" (UID: \"4bb4c9ec-22e5-42a5-8006-39f7acbc195a\") " Oct 31 07:32:35.567362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.567333 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle" pod "4bb4c9ec-22e5-42a5-8006-39f7acbc195a" (UID: "4bb4c9ec-22e5-42a5-8006-39f7acbc195a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:32:35.568816 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.568790 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv" pod "4bb4c9ec-22e5-42a5-8006-39f7acbc195a" (UID: "4bb4c9ec-22e5-42a5-8006-39f7acbc195a"). InnerVolumeSpecName "kube-api-access-zg6pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:32:35.573210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.573186 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util" pod "4bb4c9ec-22e5-42a5-8006-39f7acbc195a" (UID: "4bb4c9ec-22e5-42a5-8006-39f7acbc195a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:32:35.667681 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.667650 4406 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-util\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:32:35.667844 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.667693 4406 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-bundle\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:32:35.667844 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:35.667704 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg6pv\" (UniqueName: \"kubernetes.io/projected/4bb4c9ec-22e5-42a5-8006-39f7acbc195a-kube-api-access-zg6pv\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:32:36.442454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:36.442412 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" event={"ID":"4bb4c9ec-22e5-42a5-8006-39f7acbc195a","Type":"ContainerDied","Data":"51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189"} Oct 31 07:32:36.442454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:36.442444 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2ws82" Oct 31 07:32:36.442662 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:32:36.442476 4406 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51b25582f5159836bcbad772df869c139699a3b0a2c603b67e3b567ca10d4189" Oct 31 07:32:39.990228 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:32:39.990187 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:33:09.990223 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:33:09.990176 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:33:30.940360 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940280 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj"] Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940522 4406 cpu_manager.go:414] "containerMap: removing container" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="util" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940532 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="util" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940548 4406 cpu_manager.go:414] "containerMap: removing container" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="extract" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940554 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="extract" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940568 4406 cpu_manager.go:414] "containerMap: removing container" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="pull" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940573 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="pull" Oct 31 07:33:30.940827 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.940616 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bb4c9ec-22e5-42a5-8006-39f7acbc195a" containerName="extract" Oct 31 07:33:30.943465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.943448 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:30.971767 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:30.971738 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj"] Oct 31 07:33:31.043374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043340 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 31 07:33:31.043374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043339 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 31 07:33:31.043587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043378 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 31 07:33:31.043587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043472 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 31 07:33:31.043705 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043688 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 31 07:33:31.043742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.043687 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-4qjz7\"" Oct 31 07:33:31.053021 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.052988 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.053098 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.053037 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.053098 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.053054 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.053169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.053150 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x58jz\" (UniqueName: \"kubernetes.io/projected/719819eb-bfdd-44dc-a074-de9cad90649c-kube-api-access-x58jz\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.053212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.053180 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.053212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.053202 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154586 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154549 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154603 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154630 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154660 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58jz\" (UniqueName: \"kubernetes.io/projected/719819eb-bfdd-44dc-a074-de9cad90649c-kube-api-access-x58jz\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154700 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.154743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.154732 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.155226 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.155199 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.157156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.157129 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719819eb-bfdd-44dc-a074-de9cad90649c-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.157295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.157238 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.157363 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.157331 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.157363 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.157350 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/719819eb-bfdd-44dc-a074-de9cad90649c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.172182 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.172161 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58jz\" (UniqueName: \"kubernetes.io/projected/719819eb-bfdd-44dc-a074-de9cad90649c-kube-api-access-x58jz\") pod \"opendatahub-operator-controller-manager-6476fc869f-jlzvj\" (UID: \"719819eb-bfdd-44dc-a074-de9cad90649c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.257012 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.256930 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:31.600477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.600425 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj"] Oct 31 07:33:31.604678 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:33:31.604651 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719819eb_bfdd_44dc_a074_de9cad90649c.slice/crio-6c8a98e71d1b840c6a4aa839736134e975fba3115d5ea89fa84b661b1f0b5c6c WatchSource:0}: Error finding container 6c8a98e71d1b840c6a4aa839736134e975fba3115d5ea89fa84b661b1f0b5c6c: Status 404 returned error can't find the container with id 6c8a98e71d1b840c6a4aa839736134e975fba3115d5ea89fa84b661b1f0b5c6c Oct 31 07:33:31.606302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.606287 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:33:31.613794 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:31.613763 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerStarted","Data":"6c8a98e71d1b840c6a4aa839736134e975fba3115d5ea89fa84b661b1f0b5c6c"} Oct 31 07:33:34.627776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:34.627738 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerStarted","Data":"aaf61f0ea4d57d941f2a7a960aaea1b85850e7241110c1edebbbf82165410756"} Oct 31 07:33:35.633022 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:35.632992 4406 generic.go:356] "Generic (PLEG): container finished" podID="719819eb-bfdd-44dc-a074-de9cad90649c" containerID="aaf61f0ea4d57d941f2a7a960aaea1b85850e7241110c1edebbbf82165410756" exitCode=0 Oct 31 07:33:35.633423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:35.633030 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerDied","Data":"aaf61f0ea4d57d941f2a7a960aaea1b85850e7241110c1edebbbf82165410756"} Oct 31 07:33:36.639109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:36.639069 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerStarted","Data":"c25942e0d4e924e83b38d13b78f75fba33f2aff6739fbaa4d6128f3e30c9e015"} Oct 31 07:33:36.639899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:36.639210 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:36.727744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:36.727679 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" podStartSLOduration=3.195192751 podStartE2EDuration="6.727661055s" totalImagesPullingTime="3.08576043s" totalInitContainerRuntime="446.707874ms" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:36.71676825 +0000 UTC m=+323.363767531" watchObservedRunningTime="2026-10-31 07:33:36.727661055 +0000 UTC m=+323.374660338" Oct 31 07:33:37.961098 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.961065 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:33:37.964223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.964202 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:37.978708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.978685 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:33:37.988412 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.988388 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 31 07:33:37.988545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.988479 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 31 07:33:37.988545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:37.988505 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xkk64\"" Oct 31 07:33:38.111657 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.111618 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8km\" (UniqueName: \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.111848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.111686 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.213010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.212913 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.213010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.212991 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8km\" (UniqueName: \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.213364 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.213344 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.240688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.240656 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8km\" (UniqueName: \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\") pod \"kuadrant-operator-controller-manager-678d87766f-px4mk\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.276455 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.276423 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:38.595101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.595070 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:33:38.612834 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:33:38.612806 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadc887c_71db_4007_be59_9bfc0dd2a452.slice/crio-1ed8d05383816d9c92fda4964aef0458b587d98786abd27c38913d942bcf7213 WatchSource:0}: Error finding container 1ed8d05383816d9c92fda4964aef0458b587d98786abd27c38913d942bcf7213: Status 404 returned error can't find the container with id 1ed8d05383816d9c92fda4964aef0458b587d98786abd27c38913d942bcf7213 Oct 31 07:33:38.648122 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:38.648093 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" event={"ID":"badc887c-71db-4007-be59-9bfc0dd2a452","Type":"ContainerStarted","Data":"1ed8d05383816d9c92fda4964aef0458b587d98786abd27c38913d942bcf7213"} Oct 31 07:33:40.000999 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:33:40.000957 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:33:43.668769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:43.668731 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" event={"ID":"badc887c-71db-4007-be59-9bfc0dd2a452","Type":"ContainerStarted","Data":"29d26bb8ee0b3bfb3369d57be0a0c3e0914ba709f0b690d0bdfc93a2e7df4237"} Oct 31 07:33:43.669163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:43.668870 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:33:43.733061 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:43.733004 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" podStartSLOduration=2.728244362 podStartE2EDuration="6.732989528s" totalImagesPullingTime="4.004745166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:43.721444214 +0000 UTC m=+330.368443494" watchObservedRunningTime="2026-10-31 07:33:43.732989528 +0000 UTC m=+330.379988809" Oct 31 07:33:47.645528 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:47.645496 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 07:33:54.675204 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:33:54.675174 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:34:09.990633 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:34:09.990597 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:34:12.107142 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.107107 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb"] Oct 31 07:34:12.110463 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.110442 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.137189 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.137157 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb"] Oct 31 07:34:12.164311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.164270 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f8jfd\"" Oct 31 07:34:12.164537 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.164517 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 31 07:34:12.164537 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.164531 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 31 07:34:12.175041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.174955 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pp7v\" (UniqueName: \"kubernetes.io/projected/b923d6a1-f8b9-41de-848c-f8f44cd866c0-kube-api-access-2pp7v\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.175041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.175034 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tls-certs\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.175345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.175098 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tmp\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.275897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.275860 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tls-certs\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.276051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.275929 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tmp\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.276051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.276009 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pp7v\" (UniqueName: \"kubernetes.io/projected/b923d6a1-f8b9-41de-848c-f8f44cd866c0-kube-api-access-2pp7v\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.278382 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.278359 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tmp\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.278578 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.278548 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b923d6a1-f8b9-41de-848c-f8f44cd866c0-tls-certs\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.299323 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.299288 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pp7v\" (UniqueName: \"kubernetes.io/projected/b923d6a1-f8b9-41de-848c-f8f44cd866c0-kube-api-access-2pp7v\") pod \"kube-auth-proxy-7cdbcb4849-rxmkb\" (UID: \"b923d6a1-f8b9-41de-848c-f8f44cd866c0\") " pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.423782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.423702 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" Oct 31 07:34:12.725268 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.725163 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb"] Oct 31 07:34:12.729346 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:34:12.729312 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb923d6a1_f8b9_41de_848c_f8f44cd866c0.slice/crio-75a219fac75926cec319fffa3cc1d88dc5052a4c608528ac20705959712ac281 WatchSource:0}: Error finding container 75a219fac75926cec319fffa3cc1d88dc5052a4c608528ac20705959712ac281: Status 404 returned error can't find the container with id 75a219fac75926cec319fffa3cc1d88dc5052a4c608528ac20705959712ac281 Oct 31 07:34:12.774207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:12.774176 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" event={"ID":"b923d6a1-f8b9-41de-848c-f8f44cd866c0","Type":"ContainerStarted","Data":"75a219fac75926cec319fffa3cc1d88dc5052a4c608528ac20705959712ac281"} Oct 31 07:34:15.571731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:15.571703 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 31 07:34:15.787405 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:15.787371 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" event={"ID":"b923d6a1-f8b9-41de-848c-f8f44cd866c0","Type":"ContainerStarted","Data":"434157f904ffc465d19e6d6ae8a393a0ed3684951353adacc7d1a0f590bb218c"} Oct 31 07:34:15.823903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:15.823799 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cdbcb4849-rxmkb" podStartSLOduration=0.996041969 podStartE2EDuration="3.823785498s" totalImagesPullingTime="2.827743529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:15.822668808 +0000 UTC m=+362.469668090" watchObservedRunningTime="2026-10-31 07:34:15.823785498 +0000 UTC m=+362.470784779" Oct 31 07:34:15.997242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:15.997211 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr"] Oct 31 07:34:16.000307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.000284 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.017722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.017689 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 31 07:34:16.017884 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.017765 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-kj2hg\"" Oct 31 07:34:16.017884 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.017867 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 31 07:34:16.018625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.018598 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr"] Oct 31 07:34:16.039459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.039430 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Oct 31 07:34:16.110732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.110697 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca7c3ef-a391-45dd-adb4-96d708f71e84-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.110880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.110739 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.110880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.110820 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4d5\" (UniqueName: \"kubernetes.io/projected/7ca7c3ef-a391-45dd-adb4-96d708f71e84-kube-api-access-kw4d5\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.110880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.110877 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.211604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.211567 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.211763 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.211624 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca7c3ef-a391-45dd-adb4-96d708f71e84-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.211763 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.211645 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.211763 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.211675 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4d5\" (UniqueName: \"kubernetes.io/projected/7ca7c3ef-a391-45dd-adb4-96d708f71e84-kube-api-access-kw4d5\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.212114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.212094 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.212150 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.212116 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7c3ef-a391-45dd-adb4-96d708f71e84-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.212542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.212525 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca7c3ef-a391-45dd-adb4-96d708f71e84-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.229449 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.229426 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4d5\" (UniqueName: \"kubernetes.io/projected/7ca7c3ef-a391-45dd-adb4-96d708f71e84-kube-api-access-kw4d5\") pod \"kserve-module-controller-manager-7566cf5fc8-7jwkr\" (UID: \"7ca7c3ef-a391-45dd-adb4-96d708f71e84\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.312570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.312538 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:16.612955 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.612920 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr"] Oct 31 07:34:16.618034 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:34:16.618007 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca7c3ef_a391_45dd_adb4_96d708f71e84.slice/crio-916331f3e522de9e40b5d0d14815c8b527fd898d637f8469402b8ddf44635ecf WatchSource:0}: Error finding container 916331f3e522de9e40b5d0d14815c8b527fd898d637f8469402b8ddf44635ecf: Status 404 returned error can't find the container with id 916331f3e522de9e40b5d0d14815c8b527fd898d637f8469402b8ddf44635ecf Oct 31 07:34:16.792761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:16.792721 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" event={"ID":"7ca7c3ef-a391-45dd-adb4-96d708f71e84","Type":"ContainerStarted","Data":"916331f3e522de9e40b5d0d14815c8b527fd898d637f8469402b8ddf44635ecf"} Oct 31 07:34:18.802192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:18.802155 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" event={"ID":"7ca7c3ef-a391-45dd-adb4-96d708f71e84","Type":"ContainerStarted","Data":"ea5a78e90d13ae1ce3a566bbfead54511318154270c099807d380665063aabea"} Oct 31 07:34:18.802727 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:18.802298 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:18.849627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:18.849577 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" podStartSLOduration=2.195471568 podStartE2EDuration="3.849564978s" totalImagesPullingTime="1.65409341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:18.849267713 +0000 UTC m=+365.496266986" watchObservedRunningTime="2026-10-31 07:34:18.849564978 +0000 UTC m=+365.496564259" Oct 31 07:34:39.807401 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:34:39.807370 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-7jwkr" Oct 31 07:34:39.992417 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:34:39.992380 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:35:08.513133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.513052 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc"] Oct 31 07:35:08.525773 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.525746 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529263 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529228 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529277 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529328 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529354 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529474 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd30ea5d-8d7b-4094-b299-3df6a300a172-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529510 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wwpt\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-kube-api-access-8wwpt\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.529575 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.529556 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.551950 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.551922 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc"] Oct 31 07:35:08.630053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630027 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd30ea5d-8d7b-4094-b299-3df6a300a172-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630055 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wwpt\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-kube-api-access-8wwpt\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630073 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630100 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630294 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630388 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630361 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.630440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.630387 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.631155 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.631126 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.632611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.632589 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd30ea5d-8d7b-4094-b299-3df6a300a172-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.632720 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.632590 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.632892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.632874 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.633078 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.633050 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd30ea5d-8d7b-4094-b299-3df6a300a172-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.651151 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.651131 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wwpt\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-kube-api-access-8wwpt\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.652781 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.652759 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd30ea5d-8d7b-4094-b299-3df6a300a172-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mwpcc\" (UID: \"dd30ea5d-8d7b-4094-b299-3df6a300a172\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:08.837513 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:08.837480 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:09.140463 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.140328 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc"] Oct 31 07:35:09.144832 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:35:09.144802 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd30ea5d_8d7b_4094_b299_3df6a300a172.slice/crio-afea7fcd6fbc6aade934c02e1b593ad10cbbcf6e828e1366cf0c3a946a638cd2 WatchSource:0}: Error finding container afea7fcd6fbc6aade934c02e1b593ad10cbbcf6e828e1366cf0c3a946a638cd2: Status 404 returned error can't find the container with id afea7fcd6fbc6aade934c02e1b593ad10cbbcf6e828e1366cf0c3a946a638cd2 Oct 31 07:35:09.146885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.146851 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:35:09.146956 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.146916 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:35:09.996298 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.996228 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" event={"ID":"dd30ea5d-8d7b-4094-b299-3df6a300a172","Type":"ContainerStarted","Data":"15ca846111a61bc253490d0c4897b9e1b4ac339e728d38e7fdea2332a0e83901"} Oct 31 07:35:09.996682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.996310 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" event={"ID":"dd30ea5d-8d7b-4094-b299-3df6a300a172","Type":"ContainerStarted","Data":"afea7fcd6fbc6aade934c02e1b593ad10cbbcf6e828e1366cf0c3a946a638cd2"} Oct 31 07:35:09.996682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:09.996418 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:09.996682 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:35:09.996437 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:35:10.035383 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:10.035328 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" podStartSLOduration=2.035313476 podStartE2EDuration="2.035313476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:10.034218815 +0000 UTC m=+416.681218096" watchObservedRunningTime="2026-10-31 07:35:10.035313476 +0000 UTC m=+416.682312756" Oct 31 07:35:11.002083 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.002060 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mwpcc" Oct 31 07:35:11.077293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.077240 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:35:11.077504 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.077479 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" podUID="886ad99d-4519-43ab-af12-54f78264dd57" containerName="discovery" containerID="cri-o://80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8" gracePeriod=30 Oct 31 07:35:11.324087 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.324063 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:35:11.349575 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349548 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349594 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349620 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349838 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349814 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349904 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349977 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349942 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.349977 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349945 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:35:11.349977 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.349968 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\") pod \"886ad99d-4519-43ab-af12-54f78264dd57\" (UID: \"886ad99d-4519-43ab-af12-54f78264dd57\") " Oct 31 07:35:11.350301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.350227 4406 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-ca-configmap\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.352062 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352017 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:35:11.352168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352096 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:35:11.352232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352181 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "kube-api-access-gcl6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:35:11.352232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352200 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:35:11.352329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352272 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:35:11.352329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.352305 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert" pod "886ad99d-4519-43ab-af12-54f78264dd57" (UID: "886ad99d-4519-43ab-af12-54f78264dd57"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:35:11.450989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.450951 4406 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/886ad99d-4519-43ab-af12-54f78264dd57-local-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.450989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.450979 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcl6g\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-kube-api-access-gcl6g\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.450989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.450988 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886ad99d-4519-43ab-af12-54f78264dd57-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.450989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.450997 4406 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-cacerts\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.451229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.451004 4406 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-kubeconfig\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:11.451229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:11.451012 4406 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/886ad99d-4519-43ab-af12-54f78264dd57-istio-csr-dns-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:35:12.004820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.004775 4406 generic.go:356] "Generic (PLEG): container finished" podID="886ad99d-4519-43ab-af12-54f78264dd57" containerID="80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8" exitCode=0 Oct 31 07:35:12.005271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.004821 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" Oct 31 07:35:12.005271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.004854 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" event={"ID":"886ad99d-4519-43ab-af12-54f78264dd57","Type":"ContainerDied","Data":"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8"} Oct 31 07:35:12.005271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.004905 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs" event={"ID":"886ad99d-4519-43ab-af12-54f78264dd57","Type":"ContainerDied","Data":"0b62cf099d08d8f4a5a4b2d80b379a417483aeb5703df2e7a11e8b476bf624fa"} Oct 31 07:35:12.005271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.004942 4406 scope.go:122] "RemoveContainer" containerID="80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8" Oct 31 07:35:12.013444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.013420 4406 scope.go:122] "RemoveContainer" containerID="80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8" Oct 31 07:35:12.013724 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:35:12.013700 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8\": container with ID starting with 80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8 not found: ID does not exist" containerID="80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8" Oct 31 07:35:12.013783 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.013723 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8"} err="failed to get container status \"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8\": rpc error: code = NotFound desc = could not find container \"80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8\": container with ID starting with 80ad9b0517113f7146903139dcc3c7a92abf9807ada47c086ea11e13ec6908f8 not found: ID does not exist" Oct 31 07:35:12.061140 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.061113 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:35:12.066557 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:12.066535 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hh8bs"] Oct 31 07:35:13.475366 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:13.475335 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="886ad99d-4519-43ab-af12-54f78264dd57" path="/var/lib/kubelet/pods/886ad99d-4519-43ab-af12-54f78264dd57/volumes" Oct 31 07:35:34.370706 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.370672 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:35:34.371139 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.370939 4406 cpu_manager.go:414] "containerMap: removing container" podUID="886ad99d-4519-43ab-af12-54f78264dd57" containerName="discovery" Oct 31 07:35:34.371139 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.370951 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="886ad99d-4519-43ab-af12-54f78264dd57" containerName="discovery" Oct 31 07:35:34.371139 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.371010 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="886ad99d-4519-43ab-af12-54f78264dd57" containerName="discovery" Oct 31 07:35:34.373918 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.373897 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.398227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.398199 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 07:35:34.398379 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.398328 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 07:35:34.398454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.398388 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rrl9j\"" Oct 31 07:35:34.398454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.398416 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 07:35:34.399848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.399829 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:35:34.431294 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.431246 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9d9t\" (UniqueName: \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.431461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.431357 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.431461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.431410 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.532606 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.532571 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.532781 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.532627 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9d9t\" (UniqueName: \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.532781 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.532654 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.535065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.535033 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.535065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.535051 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.549540 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.549518 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9d9t\" (UniqueName: \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\") pod \"maas-controller-5f6b9497b-x9cqc\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.686492 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.686408 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:34.977282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:34.977179 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:35:34.983490 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:35:34.983457 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b47e62_60ad_4f54_8b5b_654e9c0f7865.slice/crio-4a107060a0161dda9c2356cb876061facaa7a9e4a2edd516f33f3143003ab1c4 WatchSource:0}: Error finding container 4a107060a0161dda9c2356cb876061facaa7a9e4a2edd516f33f3143003ab1c4: Status 404 returned error can't find the container with id 4a107060a0161dda9c2356cb876061facaa7a9e4a2edd516f33f3143003ab1c4 Oct 31 07:35:35.091483 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:35.091451 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" event={"ID":"03b47e62-60ad-4f54-8b5b-654e9c0f7865","Type":"ContainerStarted","Data":"4a107060a0161dda9c2356cb876061facaa7a9e4a2edd516f33f3143003ab1c4"} Oct 31 07:35:38.104003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:38.103967 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" event={"ID":"03b47e62-60ad-4f54-8b5b-654e9c0f7865","Type":"ContainerStarted","Data":"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587"} Oct 31 07:35:38.104452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:38.104051 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:38.138846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:38.138701 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" podStartSLOduration=1.932624109 podStartE2EDuration="4.138682375s" totalImagesPullingTime="2.206058266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:38.138141387 +0000 UTC m=+444.785140668" watchObservedRunningTime="2026-10-31 07:35:38.138682375 +0000 UTC m=+444.785681657" Oct 31 07:35:39.083441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.083409 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h"] Oct 31 07:35:39.086955 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.086934 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.099475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.099445 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 31 07:35:39.110077 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.110029 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-njhjl\"" Oct 31 07:35:39.111544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.111520 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h"] Oct 31 07:35:39.139633 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.139608 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 31 07:35:39.139633 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.139621 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 31 07:35:39.172965 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.172930 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.173172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.172976 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.173172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.173008 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbc5z\" (UniqueName: \"kubernetes.io/projected/85165338-eb50-4bdd-b164-85266fbe1c33-kube-api-access-vbc5z\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.173172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.173118 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.273847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.273814 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.273847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.273852 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.274041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.273875 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbc5z\" (UniqueName: \"kubernetes.io/projected/85165338-eb50-4bdd-b164-85266fbe1c33-kube-api-access-vbc5z\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.274041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.273905 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.274041 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:35:39.273985 4406 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Oct 31 07:35:39.274126 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:35:39.274058 4406 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert podName:85165338-eb50-4bdd-b164-85266fbe1c33 nodeName:}" failed. No retries permitted until 2026-10-31 07:35:39.774041257 +0000 UTC m=+446.421040521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" (UID: "85165338-eb50-4bdd-b164-85266fbe1c33") : secret "usage-logs-tenancy-proxy-tls" not found Oct 31 07:35:39.274600 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.274583 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.274758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.274742 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/85165338-eb50-4bdd-b164-85266fbe1c33-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.293623 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.293599 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbc5z\" (UniqueName: \"kubernetes.io/projected/85165338-eb50-4bdd-b164-85266fbe1c33-kube-api-access-vbc5z\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.778881 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.778846 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.781225 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.781192 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85165338-eb50-4bdd-b164-85266fbe1c33-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-mqt5h\" (UID: \"85165338-eb50-4bdd-b164-85266fbe1c33\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:39.990957 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:35:39.990920 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:35:39.999215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:39.999195 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:40.289700 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:40.289667 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h"] Oct 31 07:35:40.294129 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:35:40.294102 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85165338_eb50_4bdd_b164_85266fbe1c33.slice/crio-9a4420517749cae43fb45e80de57350971ca817b2e8664affe15208810abf230 WatchSource:0}: Error finding container 9a4420517749cae43fb45e80de57350971ca817b2e8664affe15208810abf230: Status 404 returned error can't find the container with id 9a4420517749cae43fb45e80de57350971ca817b2e8664affe15208810abf230 Oct 31 07:35:41.117410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:41.117375 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" event={"ID":"85165338-eb50-4bdd-b164-85266fbe1c33","Type":"ContainerStarted","Data":"9a4420517749cae43fb45e80de57350971ca817b2e8664affe15208810abf230"} Oct 31 07:35:49.111195 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:49.111163 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:35:51.171361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:51.171321 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" event={"ID":"85165338-eb50-4bdd-b164-85266fbe1c33","Type":"ContainerStarted","Data":"81cfb7b45779472ed07271c5d8a99002f821df001acc9c7c4ea0b2c788bfe454"} Oct 31 07:35:51.171876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:51.171460 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:35:51.205549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:35:51.205384 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" podStartSLOduration=1.9239715419999999 podStartE2EDuration="12.205368294s" totalImagesPullingTime="10.281396752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:51.204430967 +0000 UTC m=+457.851430247" watchObservedRunningTime="2026-10-31 07:35:51.205368294 +0000 UTC m=+457.852367604" Oct 31 07:36:02.181110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:02.181076 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-mqt5h" Oct 31 07:36:09.990398 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:36:09.990359 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:36:21.233161 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.233085 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 07:36:21.419572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.419540 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 07:36:21.419740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.419643 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.442832 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.442784 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 31 07:36:21.442978 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.442834 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 31 07:36:21.442978 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.442945 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 31 07:36:21.443084 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.443013 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 31 07:36:21.445610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.445596 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n7bj\"" Oct 31 07:36:21.523476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.523398 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.523640 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.523591 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlv2\" (UniqueName: \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.523716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.523655 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.523716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.523687 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.625066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.625033 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.625258 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.625103 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlv2\" (UniqueName: \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.625258 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.625127 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.625258 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.625143 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.626290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.626231 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.627656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.627627 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.627753 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.627720 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.642409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.642384 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlv2\" (UniqueName: \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\") pod \"maas-api-79fc8bc9c5-jdz9r\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:21.771549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:21.771518 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:22.137998 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:22.137969 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 07:36:22.141923 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:36:22.141897 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae51ead_2f1a_4b6f_8abf_f04cbd82ddd9.slice/crio-af5af8cac31ee02cc0d3cd0ed8c0479e39893a8d31a358b255c8aef341a7c7c0 WatchSource:0}: Error finding container af5af8cac31ee02cc0d3cd0ed8c0479e39893a8d31a358b255c8aef341a7c7c0: Status 404 returned error can't find the container with id af5af8cac31ee02cc0d3cd0ed8c0479e39893a8d31a358b255c8aef341a7c7c0 Oct 31 07:36:22.287340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:22.287305 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" event={"ID":"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9","Type":"ContainerStarted","Data":"af5af8cac31ee02cc0d3cd0ed8c0479e39893a8d31a358b255c8aef341a7c7c0"} Oct 31 07:36:24.297410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:24.297377 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" event={"ID":"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9","Type":"ContainerStarted","Data":"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f"} Oct 31 07:36:24.297838 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:24.297604 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:24.334062 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:24.333985 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" podStartSLOduration=1.755493724 podStartE2EDuration="3.333969685s" totalImagesPullingTime="1.578475961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:24.333313057 +0000 UTC m=+490.980312335" watchObservedRunningTime="2026-10-31 07:36:24.333969685 +0000 UTC m=+490.980968965" Oct 31 07:36:30.306707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:36:30.306621 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 07:36:39.991499 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:36:39.991459 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:37:09.992027 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:37:09.991984 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:37:16.642197 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.642153 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj"] Oct 31 07:37:16.645664 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.645640 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.658704 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.658671 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 31 07:37:16.661030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.661009 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 31 07:37:16.664014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.663986 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.664125 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.664030 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.664171 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.664121 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.664171 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.664160 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.664294 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.664184 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9krzn\" (UniqueName: \"kubernetes.io/projected/7a8e0cf5-c25b-413d-b432-dec2128252a6-kube-api-access-9krzn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.664294 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.664280 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a8e0cf5-c25b-413d-b432-dec2128252a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.669441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.669420 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mghfb\"" Oct 31 07:37:16.671242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.671216 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj"] Oct 31 07:37:16.671867 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.671849 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Oct 31 07:37:16.765551 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765513 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9krzn\" (UniqueName: \"kubernetes.io/projected/7a8e0cf5-c25b-413d-b432-dec2128252a6-kube-api-access-9krzn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.765758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765572 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a8e0cf5-c25b-413d-b432-dec2128252a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.765758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765645 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.765758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765671 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.765758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765711 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.765758 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.765753 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.766282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.766124 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.766282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.766171 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.766282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.766234 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.768148 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.768119 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a8e0cf5-c25b-413d-b432-dec2128252a6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.768390 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.768371 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a8e0cf5-c25b-413d-b432-dec2128252a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.783962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.783941 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9krzn\" (UniqueName: \"kubernetes.io/projected/7a8e0cf5-c25b-413d-b432-dec2128252a6-kube-api-access-9krzn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9hnvj\" (UID: \"7a8e0cf5-c25b-413d-b432-dec2128252a6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:16.960092 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:16.960021 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:17.256493 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:17.256339 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj"] Oct 31 07:37:17.261406 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:17.261373 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8e0cf5_c25b_413d_b432_dec2128252a6.slice/crio-2ed3aa4819a34f29ccd1a98dd5022fdf5de3aaac3012c987b22920746ff5dc5e WatchSource:0}: Error finding container 2ed3aa4819a34f29ccd1a98dd5022fdf5de3aaac3012c987b22920746ff5dc5e: Status 404 returned error can't find the container with id 2ed3aa4819a34f29ccd1a98dd5022fdf5de3aaac3012c987b22920746ff5dc5e Oct 31 07:37:17.502961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:17.502907 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" event={"ID":"7a8e0cf5-c25b-413d-b432-dec2128252a6","Type":"ContainerStarted","Data":"2ed3aa4819a34f29ccd1a98dd5022fdf5de3aaac3012c987b22920746ff5dc5e"} Oct 31 07:37:19.513109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:19.513074 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" event={"ID":"7a8e0cf5-c25b-413d-b432-dec2128252a6","Type":"ContainerStarted","Data":"3273e1c542e2e7cd36f5b6a7a616e16e22a96c719f3c79721757d80c60372d3f"} Oct 31 07:37:19.551269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:19.551203 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" podStartSLOduration=2.303876715 podStartE2EDuration="3.551185236s" totalImagesPullingTime="1.247308521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:19.549396664 +0000 UTC m=+546.196395947" watchObservedRunningTime="2026-10-31 07:37:19.551185236 +0000 UTC m=+546.198184518" Oct 31 07:37:19.960314 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:19.960280 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:21.030593 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.030557 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27"] Oct 31 07:37:21.033902 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.033875 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.057603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.057575 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Oct 31 07:37:21.058813 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.058785 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27"] Oct 31 07:37:21.095684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095655 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.095811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095694 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.095811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095711 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vf96\" (UniqueName: \"kubernetes.io/projected/f9980644-f455-478c-9d58-7e02ea1e1ae0-kube-api-access-4vf96\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.095900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095853 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.095934 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095897 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.095966 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.095944 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9980644-f455-478c-9d58-7e02ea1e1ae0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196369 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196419 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196451 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9980644-f455-478c-9d58-7e02ea1e1ae0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196491 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196632 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196665 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vf96\" (UniqueName: \"kubernetes.io/projected/f9980644-f455-478c-9d58-7e02ea1e1ae0-kube-api-access-4vf96\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196829 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.196885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.196847 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.197047 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.197025 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.198863 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.198837 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9980644-f455-478c-9d58-7e02ea1e1ae0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.199136 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.199120 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9980644-f455-478c-9d58-7e02ea1e1ae0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.213595 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.213568 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vf96\" (UniqueName: \"kubernetes.io/projected/f9980644-f455-478c-9d58-7e02ea1e1ae0-kube-api-access-4vf96\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gvj27\" (UID: \"f9980644-f455-478c-9d58-7e02ea1e1ae0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.347900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.347867 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:21.640289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:21.640241 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27"] Oct 31 07:37:21.644083 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:21.644059 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9980644_f455_478c_9d58_7e02ea1e1ae0.slice/crio-d73f55499075105a3b26ad1a77ce8a9e1032479e9fa3251f88014378a07d2392 WatchSource:0}: Error finding container d73f55499075105a3b26ad1a77ce8a9e1032479e9fa3251f88014378a07d2392: Status 404 returned error can't find the container with id d73f55499075105a3b26ad1a77ce8a9e1032479e9fa3251f88014378a07d2392 Oct 31 07:37:22.525570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.525536 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" event={"ID":"f9980644-f455-478c-9d58-7e02ea1e1ae0","Type":"ContainerStarted","Data":"70fe8ad58e482648e555b6134f121ae7c4c557376091ccc804f8acce182968ad"} Oct 31 07:37:22.526030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.525587 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" event={"ID":"f9980644-f455-478c-9d58-7e02ea1e1ae0","Type":"ContainerStarted","Data":"d73f55499075105a3b26ad1a77ce8a9e1032479e9fa3251f88014378a07d2392"} Oct 31 07:37:22.561554 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.561494 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" podStartSLOduration=1.353535468 podStartE2EDuration="1.561473439s" totalImagesPullingTime="207.937971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:22.560018428 +0000 UTC m=+549.207017709" watchObservedRunningTime="2026-10-31 07:37:22.561473439 +0000 UTC m=+549.208472719" Oct 31 07:37:22.805754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.805657 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw"] Oct 31 07:37:22.808933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.808911 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.822405 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.822378 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Oct 31 07:37:22.834667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.834627 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw"] Oct 31 07:37:22.911524 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911494 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.911715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911536 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97a67a77-654f-4689-91ce-f622fb1ca988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.911715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911568 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjkqd\" (UniqueName: \"kubernetes.io/projected/97a67a77-654f-4689-91ce-f622fb1ca988-kube-api-access-rjkqd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.911715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911696 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.911855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911729 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:22.911887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:22.911848 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012652 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012691 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97a67a77-654f-4689-91ce-f622fb1ca988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012963 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012714 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjkqd\" (UniqueName: \"kubernetes.io/projected/97a67a77-654f-4689-91ce-f622fb1ca988-kube-api-access-rjkqd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012963 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012759 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012963 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012779 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.012963 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.012846 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.013177 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.013152 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.013218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.013192 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.013218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.013204 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.015149 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.015124 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97a67a77-654f-4689-91ce-f622fb1ca988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.015284 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.015266 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97a67a77-654f-4689-91ce-f622fb1ca988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.029846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.029824 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjkqd\" (UniqueName: \"kubernetes.io/projected/97a67a77-654f-4689-91ce-f622fb1ca988-kube-api-access-rjkqd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw\" (UID: \"97a67a77-654f-4689-91ce-f622fb1ca988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.121921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.121881 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:23.348697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.348670 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:23.411796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.411703 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw"] Oct 31 07:37:23.531261 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:23.531209 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" event={"ID":"97a67a77-654f-4689-91ce-f622fb1ca988","Type":"ContainerStarted","Data":"3458f29219670330a966c959bc20542e3ce0a298f29b309c2dcf97bb50ca8505"} Oct 31 07:37:24.537688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:24.537643 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" event={"ID":"97a67a77-654f-4689-91ce-f622fb1ca988","Type":"ContainerStarted","Data":"4e7921a37e1d3da227836a53467a1a6eee0fa3ddf742558194b8ff866c1de236"} Oct 31 07:37:24.583467 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:24.583413 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" podStartSLOduration=2.379582085 podStartE2EDuration="2.583398548s" totalImagesPullingTime="203.816463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:24.581617373 +0000 UTC m=+551.228616656" watchObservedRunningTime="2026-10-31 07:37:24.583398548 +0000 UTC m=+551.230397844" Oct 31 07:37:25.122810 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:25.122769 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:26.960235 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:26.960199 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:26.978000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:26.977961 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:27.564850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:27.564818 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9hnvj" Oct 31 07:37:31.348752 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:31.348718 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:31.361805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:31.361774 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:31.579299 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:31.579246 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gvj27" Oct 31 07:37:33.122788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.122752 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:33.135964 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.135932 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:33.272289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.272234 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd"] Oct 31 07:37:33.276061 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.276036 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.297388 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.297351 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 31 07:37:33.299172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.299142 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd"] Oct 31 07:37:33.302946 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.302868 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.302946 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.302911 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z89cb\" (UniqueName: \"kubernetes.io/projected/462d933b-e164-4df9-aa16-391c4a96899c-kube-api-access-z89cb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.303116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.302957 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.303116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.302988 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/462d933b-e164-4df9-aa16-391c4a96899c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.303116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.303025 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.303116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.303078 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.403825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.403736 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.403825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.403778 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z89cb\" (UniqueName: \"kubernetes.io/projected/462d933b-e164-4df9-aa16-391c4a96899c-kube-api-access-z89cb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.403884 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.403916 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/462d933b-e164-4df9-aa16-391c4a96899c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.403963 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.404020 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.404461 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.404526 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.404674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.404619 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.407619 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.407595 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/462d933b-e164-4df9-aa16-391c4a96899c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.408004 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.407980 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/462d933b-e164-4df9-aa16-391c4a96899c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.423079 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.423053 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z89cb\" (UniqueName: \"kubernetes.io/projected/462d933b-e164-4df9-aa16-391c4a96899c-kube-api-access-z89cb\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd\" (UID: \"462d933b-e164-4df9-aa16-391c4a96899c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.590967 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.590932 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw" Oct 31 07:37:33.591168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.590951 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:33.903296 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:33.903165 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd"] Oct 31 07:37:33.921800 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:33.906980 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462d933b_e164_4df9_aa16_391c4a96899c.slice/crio-f8c4f3fa730b6551392add47ee69fef67153b066618621b928cf1fd65ef32c4d WatchSource:0}: Error finding container f8c4f3fa730b6551392add47ee69fef67153b066618621b928cf1fd65ef32c4d: Status 404 returned error can't find the container with id f8c4f3fa730b6551392add47ee69fef67153b066618621b928cf1fd65ef32c4d Oct 31 07:37:34.584212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:34.584171 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" event={"ID":"462d933b-e164-4df9-aa16-391c4a96899c","Type":"ContainerStarted","Data":"08c8ed7f47d9ba4f419ef9f42b83bf0d874bcc22140de5eaa93fc94e257cc17e"} Oct 31 07:37:34.584739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:34.584235 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" event={"ID":"462d933b-e164-4df9-aa16-391c4a96899c","Type":"ContainerStarted","Data":"f8c4f3fa730b6551392add47ee69fef67153b066618621b928cf1fd65ef32c4d"} Oct 31 07:37:34.591448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:34.591427 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:34.619010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:34.618966 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" podStartSLOduration=1.436354652 podStartE2EDuration="1.618953478s" totalImagesPullingTime="182.598826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:34.618047856 +0000 UTC m=+561.265047137" watchObservedRunningTime="2026-10-31 07:37:34.618953478 +0000 UTC m=+561.265952759" Oct 31 07:37:39.990584 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:37:39.990545 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:37:41.062276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.062164 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 07:37:41.066732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.066703 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.072461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.072431 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 07:37:41.076042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.076020 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.086580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.086143 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 07:37:41.093950 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.093923 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 07:37:41.166459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.166426 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m48c6\"" Oct 31 07:37:41.169794 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169766 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.169919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169806 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szz9s\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.169919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169833 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.169919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169897 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169942 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.169973 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8424q\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170003 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170020 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170074 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170193 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170222 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170278 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170305 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170332 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170374 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170405 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170429 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.170739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.170534 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.271175 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271137 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8424q\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.271175 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271180 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271200 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271341 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271399 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271421 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271442 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.271464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271462 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271639 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271654 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271685 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271709 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271728 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271749 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271830 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271838 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271864 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.271976 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272006 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szz9s\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272037 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272041 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272048 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272061 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272167 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.272970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272694 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.272970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272898 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.273125 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.272993 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.273272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.273237 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.274534 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.274501 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.274534 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.274524 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.275378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.275359 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.275462 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.275374 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.288680 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.288649 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8424q\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.289446 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.289420 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.289446 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.289436 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-gbzm6\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.289736 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.289717 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szz9s\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\") pod \"maas-default-gateway-openshift-default-645cf464d7-2r8hh\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.383713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.383683 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:41.398202 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.397963 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:41.699074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.698962 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 07:37:41.701683 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:41.701656 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 07:37:41.703588 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:41.703500 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca259464_bb5e_43be_833d_3d7d5e9e45ea.slice/crio-43ab04607826c30e3fb35af96025bc4ceb06ed05c0b315a27f53ad58d1b6db48 WatchSource:0}: Error finding container 43ab04607826c30e3fb35af96025bc4ceb06ed05c0b315a27f53ad58d1b6db48: Status 404 returned error can't find the container with id 43ab04607826c30e3fb35af96025bc4ceb06ed05c0b315a27f53ad58d1b6db48 Oct 31 07:37:41.705730 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:41.705705 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5252cc_f747_4421_ac45_ce3ff36e6b0c.slice/crio-c0c9773b48b2fbfd7814ade37e35f4bc308d969f8598623de677d189b63c05a4 WatchSource:0}: Error finding container c0c9773b48b2fbfd7814ade37e35f4bc308d969f8598623de677d189b63c05a4: Status 404 returned error can't find the container with id c0c9773b48b2fbfd7814ade37e35f4bc308d969f8598623de677d189b63c05a4 Oct 31 07:37:42.620866 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:42.620828 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" event={"ID":"8c5252cc-f747-4421-ac45-ce3ff36e6b0c","Type":"ContainerStarted","Data":"c0c9773b48b2fbfd7814ade37e35f4bc308d969f8598623de677d189b63c05a4"} Oct 31 07:37:42.622430 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:42.622401 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" event={"ID":"ca259464-bb5e-43be-833d-3d7d5e9e45ea","Type":"ContainerStarted","Data":"43ab04607826c30e3fb35af96025bc4ceb06ed05c0b315a27f53ad58d1b6db48"} Oct 31 07:37:43.591686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:43.591656 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:43.607228 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:43.607194 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:43.646636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:43.646609 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd" Oct 31 07:37:44.610462 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.610427 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:44.610577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.610497 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:44.610577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.610527 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:44.620073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.620040 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:44.620169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.620121 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:44.620169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:44.620161 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:45.654582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:45.654537 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" event={"ID":"8c5252cc-f747-4421-ac45-ce3ff36e6b0c","Type":"ContainerStarted","Data":"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5"} Oct 31 07:37:45.656714 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:45.656690 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" event={"ID":"ca259464-bb5e-43be-833d-3d7d5e9e45ea","Type":"ContainerStarted","Data":"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c"} Oct 31 07:37:45.746276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:45.745924 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podStartSLOduration=1.834074385 podStartE2EDuration="4.745903609s" totalImagesPullingTime="2.911829224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:45.719740737 +0000 UTC m=+572.366740021" watchObservedRunningTime="2026-10-31 07:37:45.745903609 +0000 UTC m=+572.392902894" Oct 31 07:37:45.768797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:45.768739 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podStartSLOduration=1.865087007 podStartE2EDuration="4.768723795s" totalImagesPullingTime="2.903636788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:45.767517635 +0000 UTC m=+572.414516926" watchObservedRunningTime="2026-10-31 07:37:45.768723795 +0000 UTC m=+572.415723077" Oct 31 07:37:46.384797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.384754 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:46.386018 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.385994 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:46.386090 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.386041 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:46.398533 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.398514 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:46.399548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.399526 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:46.399596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:46.399565 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:47.384387 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:47.384353 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:47.384785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:47.384408 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:47.398773 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:47.398754 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:47.398870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:47.398785 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:48.384433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:48.384380 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:48.384926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:48.384460 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:48.398801 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:48.398769 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:48.398917 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:48.398828 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:49.384423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:49.384385 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:49.384602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:49.384455 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:49.398753 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:49.398724 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:49.398855 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:49.398765 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:50.384293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:50.384237 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:50.384474 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:50.384319 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:50.399047 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:50.399016 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:50.399401 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:50.399062 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:51.384882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:51.384844 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Oct 31 07:37:51.385070 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:51.384896 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Oct 31 07:37:51.399325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:51.399291 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Oct 31 07:37:51.399661 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:51.399355 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Oct 31 07:37:52.949024 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:52.948987 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:52.950368 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:52.950344 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:52.951066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:52.951044 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 07:37:53.023370 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:53.023342 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:53.023756 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:53.023729 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:53.024849 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:53.024828 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 07:37:56.046225 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.046151 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 07:37:56.053213 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.053192 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.068561 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.068536 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 07:37:56.149129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149099 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149133 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149159 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149179 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149274 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149352 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gd2\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149401 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149424 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.149508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.149457 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250417 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250453 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250477 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250527 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250558 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250581 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gd2\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250615 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250707 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250735 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250919 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.250959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.250931 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.251175 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.251151 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.251227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.251189 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.251426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.251407 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.253366 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.253338 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.253671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.253651 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.266807 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.266786 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.266959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.266940 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gd2\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\") pod \"maas-default-gateway-openshift-default-645cf464d7-6g544\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.369405 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.369371 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:56.679801 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.679663 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 07:37:56.684608 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:37:56.684583 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc781af22_f657_4feb_b561_ea999019ba26.slice/crio-708f3e108aaf70401e88de9497d7910060d96ddb0258df0b7cb8b111b816b8bf WatchSource:0}: Error finding container 708f3e108aaf70401e88de9497d7910060d96ddb0258df0b7cb8b111b816b8bf: Status 404 returned error can't find the container with id 708f3e108aaf70401e88de9497d7910060d96ddb0258df0b7cb8b111b816b8bf Oct 31 07:37:56.687724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.687686 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:56.687824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.687755 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:56.687824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.687794 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:37:56.714550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:56.714523 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" event={"ID":"c781af22-f657-4feb-b561-ea999019ba26","Type":"ContainerStarted","Data":"708f3e108aaf70401e88de9497d7910060d96ddb0258df0b7cb8b111b816b8bf"} Oct 31 07:37:57.733229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:57.733189 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" event={"ID":"c781af22-f657-4feb-b561-ea999019ba26","Type":"ContainerStarted","Data":"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66"} Oct 31 07:37:57.791305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:57.791236 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podStartSLOduration=1.7912222199999999 podStartE2EDuration="1.79122222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:57.780274993 +0000 UTC m=+584.427274271" watchObservedRunningTime="2026-10-31 07:37:57.79122222 +0000 UTC m=+584.438221501" Oct 31 07:37:58.369849 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:58.369798 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:37:58.370880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:58.370849 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:37:58.370991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:58.370912 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:37:59.370555 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:59.370519 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:37:59.371181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:37:59.371128 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:38:00.370693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:00.370652 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:38:00.371765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:00.371336 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:38:01.370269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:01.370214 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:38:01.370481 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:01.370293 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:38:02.370747 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:02.370711 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:38:02.371129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:02.370762 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:38:03.370142 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:03.370100 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 31 07:38:03.370352 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:03.370172 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 31 07:38:05.371487 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:05.371437 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:38:05.372030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:05.371505 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:38:06.413444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:06.413396 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:38:06.413968 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:06.413469 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:38:07.028307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:07.028275 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:38:07.028627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:07.028591 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:38:07.029469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:07.029445 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 07:38:09.990689 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:38:09.990649 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:38:39.991263 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:38:39.991215 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:38:47.651761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.651728 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:38:47.656175 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.656154 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.670188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.670165 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-3cc201-openshift-default-dockercfg-2c2sr\"" Oct 31 07:38:47.682991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.682962 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:38:47.756427 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756393 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756609 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756436 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756609 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756456 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756607 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756642 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756671 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756697 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldb94\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756730 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.756875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.756755 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.857757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857723 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.857757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857756 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857774 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857802 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldb94\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857828 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857845 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857912 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857951 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.857974 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858396 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.858222 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858396 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.858299 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.858418 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858560 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.858492 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.858782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.858759 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.860217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.860201 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.860460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.860442 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.878565 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.878543 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldb94\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.880917 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.880891 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:47.884131 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.884106 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:38:47.889819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.889796 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.908218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.908136 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:38:47.929622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.929592 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b4e8fd-openshift-default-dockercfg-v2jcn\"" Oct 31 07:38:47.958636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958603 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.958768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958661 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.958768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958725 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.958844 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958769 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxx69\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.958877 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958843 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.958992 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.958978 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.959027 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.959004 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.959067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.959026 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.959118 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.959069 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:47.969200 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:47.969181 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:48.060116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060071 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxx69\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060133 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060188 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060216 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060281 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060309 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060350 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060400 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.060776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060431 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.061066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.060836 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.062123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.062094 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.062453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.062431 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.062789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.062758 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.062860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.062842 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.063687 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.063662 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.064340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.064315 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.080129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.080102 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.080217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.080197 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxx69\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.205697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.205607 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:48.239101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.239070 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:38:48.243310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.243244 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.262336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.261098 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-648fbe-openshift-default-dockercfg-2vh69\"" Oct 31 07:38:48.266266 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.266064 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:38:48.295286 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.292100 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:38:48.296819 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:38:48.296789 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2cb74d_fc64_4682_8d33_4c912e70f766.slice/crio-ec7ea985b4fc6878e0713da31f8ea7d0991c866f69f1c48bce5e6657301ba016 WatchSource:0}: Error finding container ec7ea985b4fc6878e0713da31f8ea7d0991c866f69f1c48bce5e6657301ba016: Status 404 returned error can't find the container with id ec7ea985b4fc6878e0713da31f8ea7d0991c866f69f1c48bce5e6657301ba016 Oct 31 07:38:48.299851 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.299801 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.299942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.299893 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.299989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.299943 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.363880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.363798 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.363880 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.363857 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.364065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.363982 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.364134 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364112 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.366728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364174 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.366728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364204 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.366728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364327 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgxds\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.366728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364396 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.366728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.364429 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470133 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470201 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470234 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470279 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470319 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgxds\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470353 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470388 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470466 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.470497 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.471000 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.473374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.471230 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.474034 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.473937 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.475011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.474309 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.475011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.474765 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.484535 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.484502 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.495921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.495860 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.498949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.498880 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.499782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.499754 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgxds\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.534178 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.534090 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:38:48.546122 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:38:48.546080 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8562a3bf_ed14_4f79_8620_df185cb09a96.slice/crio-38975fdc0957ed84d0317242fe77e9674e20d9e2d16a16e6c921759df26e069f WatchSource:0}: Error finding container 38975fdc0957ed84d0317242fe77e9674e20d9e2d16a16e6c921759df26e069f: Status 404 returned error can't find the container with id 38975fdc0957ed84d0317242fe77e9674e20d9e2d16a16e6c921759df26e069f Oct 31 07:38:48.549289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.549223 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.549378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.549324 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.549378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.549362 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.570912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.570721 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:48.896637 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.896603 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:38:48.900891 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:38:48.900846 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df2bdd0_ab56_4443_b8ef_226466813d05.slice/crio-1344b7eb70fa9b5294c8f173c4867b7d74807a926493a2d369d8fe045904caeb WatchSource:0}: Error finding container 1344b7eb70fa9b5294c8f173c4867b7d74807a926493a2d369d8fe045904caeb: Status 404 returned error can't find the container with id 1344b7eb70fa9b5294c8f173c4867b7d74807a926493a2d369d8fe045904caeb Oct 31 07:38:48.903723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.903681 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.903838 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.903763 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:48.903838 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:48.903804 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:38:49.017100 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.017061 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerStarted","Data":"1344b7eb70fa9b5294c8f173c4867b7d74807a926493a2d369d8fe045904caeb"} Oct 31 07:38:49.018860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.018828 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerStarted","Data":"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb"} Oct 31 07:38:49.019084 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.019042 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerStarted","Data":"ec7ea985b4fc6878e0713da31f8ea7d0991c866f69f1c48bce5e6657301ba016"} Oct 31 07:38:49.020962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.020935 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerStarted","Data":"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b"} Oct 31 07:38:49.021065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.020985 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerStarted","Data":"38975fdc0957ed84d0317242fe77e9674e20d9e2d16a16e6c921759df26e069f"} Oct 31 07:38:49.059050 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.058995 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podStartSLOduration=2.058981119 podStartE2EDuration="2.058981119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:49.057566836 +0000 UTC m=+635.704566118" watchObservedRunningTime="2026-10-31 07:38:49.058981119 +0000 UTC m=+635.705980399" Oct 31 07:38:49.097067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.097017 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podStartSLOduration=2.097002043 podStartE2EDuration="2.097002043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:49.094884526 +0000 UTC m=+635.741883807" watchObservedRunningTime="2026-10-31 07:38:49.097002043 +0000 UTC m=+635.744001323" Oct 31 07:38:49.209286 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.209176 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:49.214972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.214946 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:49.970395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.970351 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:49.976410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:49.976384 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:50.029431 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.029386 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerStarted","Data":"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380"} Oct 31 07:38:50.029873 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.029772 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:50.029873 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.029825 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:50.030731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.030708 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:38:50.030853 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.030836 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:38:50.072451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.069618 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podStartSLOduration=2.069599863 podStartE2EDuration="2.069599863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:50.06668938 +0000 UTC m=+636.713688661" watchObservedRunningTime="2026-10-31 07:38:50.069599863 +0000 UTC m=+636.716599145" Oct 31 07:38:50.571135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.571106 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:50.576821 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:50.576795 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:51.035238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:51.035206 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:51.036359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:51.036332 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:38:54.184689 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.184654 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:38:54.188672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.188651 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.206124 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.206104 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-3cc201-serving-cert\"" Oct 31 07:38:54.216278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.216232 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:38:54.233133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.233101 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.233298 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.233155 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnsdw\" (UniqueName: \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.233298 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.233281 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.233398 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.233381 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.334553 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.334517 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.334732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.334644 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.334732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.334668 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnsdw\" (UniqueName: \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.334732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.334689 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.335398 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.335357 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.337102 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.337077 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.337299 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.337278 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.352081 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.352059 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnsdw\" (UniqueName: \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\") pod \"maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.501164 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.501084 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:54.806350 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.801432 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:38:54.826564 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:38:54.826515 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f81653_6f76_4ad3_9d2e_eaa881bca454.slice/crio-7c0bd5220351adc0e089b4ef9ce870ae41b9175c8da33693ffecd75268ead194 WatchSource:0}: Error finding container 7c0bd5220351adc0e089b4ef9ce870ae41b9175c8da33693ffecd75268ead194: Status 404 returned error can't find the container with id 7c0bd5220351adc0e089b4ef9ce870ae41b9175c8da33693ffecd75268ead194 Oct 31 07:38:54.828667 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:54.828642 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:38:55.102581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:55.102546 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" event={"ID":"17f81653-6f76-4ad3-9d2e-eaa881bca454","Type":"ContainerStarted","Data":"7c0bd5220351adc0e089b4ef9ce870ae41b9175c8da33693ffecd75268ead194"} Oct 31 07:38:56.112628 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:56.112597 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" event={"ID":"17f81653-6f76-4ad3-9d2e-eaa881bca454","Type":"ContainerStarted","Data":"deb4e7307bc90e1ca2561bab61ae4b52acd8edffcb99915b576446c374280152"} Oct 31 07:38:56.113036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:56.112769 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:38:56.150400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:56.150351 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" podStartSLOduration=1.684601952 podStartE2EDuration="2.150338728s" totalImagesPullingTime="465.736776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:56.146916498 +0000 UTC m=+642.793915789" watchObservedRunningTime="2026-10-31 07:38:56.150338728 +0000 UTC m=+642.797338009" Oct 31 07:38:57.821568 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.821522 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:38:57.825578 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.825557 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.849601 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.849570 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-b1fda4-serving-cert\"" Oct 31 07:38:57.851474 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.851444 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:38:57.894691 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.894656 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.894858 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.894699 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.894858 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.894811 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.894858 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.894844 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsbdb\" (UniqueName: \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.995607 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.995574 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsbdb\" (UniqueName: \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.995786 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.995627 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.995884 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.995861 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.996015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.995999 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.996529 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.996503 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.998128 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.998109 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:57.998209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:57.998192 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:58.018471 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:58.018439 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsbdb\" (UniqueName: \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\") pod \"maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:58.139032 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:58.138999 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:58.430896 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:58.430790 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:38:58.435231 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:38:58.435205 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7c760d_efb8_4e34_ac8b_0202884bbcd1.slice/crio-c60a78c152cebdef14fbc852e46006fc9deeea7ac017a95442270d164412d770 WatchSource:0}: Error finding container c60a78c152cebdef14fbc852e46006fc9deeea7ac017a95442270d164412d770: Status 404 returned error can't find the container with id c60a78c152cebdef14fbc852e46006fc9deeea7ac017a95442270d164412d770 Oct 31 07:38:59.171651 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.171616 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" event={"ID":"7c7c760d-efb8-4e34-ac8b-0202884bbcd1","Type":"ContainerStarted","Data":"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026"} Oct 31 07:38:59.172223 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.172199 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" event={"ID":"7c7c760d-efb8-4e34-ac8b-0202884bbcd1","Type":"ContainerStarted","Data":"c60a78c152cebdef14fbc852e46006fc9deeea7ac017a95442270d164412d770"} Oct 31 07:38:59.173574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.173551 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:38:59.223287 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.221569 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" podStartSLOduration=1.9174072340000001 podStartE2EDuration="2.221547781s" totalImagesPullingTime="304.140547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:59.22018606 +0000 UTC m=+645.867185353" watchObservedRunningTime="2026-10-31 07:38:59.221547781 +0000 UTC m=+645.868547063" Oct 31 07:38:59.730353 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.730319 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:38:59.733724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.733697 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.751207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.751184 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-648fbe\"" Oct 31 07:38:59.752678 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.752655 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:38:59.764370 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.764345 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-648fbe-dockercfg-mmkd9\"" Oct 31 07:38:59.852276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.844848 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndgf\" (UniqueName: \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.852276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.845012 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.946015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.945979 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.946171 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.946056 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndgf\" (UniqueName: \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.946933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.946914 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:38:59.963042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:38:59.963008 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndgf\" (UniqueName: \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\") pod \"payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:39:00.046739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:00.046640 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:39:00.388419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:00.388387 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:39:00.392487 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:39:00.392460 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992f19b3_a06c_4c02_a976_cf5f2f33f61a.slice/crio-eaf4be90033efbc03577a33278c11b56249c16752ecf3a6013c7cc78ac96f9da WatchSource:0}: Error finding container eaf4be90033efbc03577a33278c11b56249c16752ecf3a6013c7cc78ac96f9da: Status 404 returned error can't find the container with id eaf4be90033efbc03577a33278c11b56249c16752ecf3a6013c7cc78ac96f9da Oct 31 07:39:01.186157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:01.186120 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" event={"ID":"992f19b3-a06c-4c02-a976-cf5f2f33f61a","Type":"ContainerStarted","Data":"eaf4be90033efbc03577a33278c11b56249c16752ecf3a6013c7cc78ac96f9da"} Oct 31 07:39:02.136820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:02.136787 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:39:04.020279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.019339 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:39:04.030110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.030086 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.035330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.035285 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:39:04.043017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.042991 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-b4e8fd\"" Oct 31 07:39:04.043156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.043138 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-b4e8fd-dockercfg-4k84v\"" Oct 31 07:39:04.157307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.156312 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbz8\" (UniqueName: \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.157307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.156401 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.220885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.220780 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" event={"ID":"992f19b3-a06c-4c02-a976-cf5f2f33f61a","Type":"ContainerStarted","Data":"767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a"} Oct 31 07:39:04.221069 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.220908 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:39:04.255715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.255658 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" podStartSLOduration=1.689465043 podStartE2EDuration="5.255643443s" totalImagesPullingTime="3.5661784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:04.254474667 +0000 UTC m=+650.901473949" watchObservedRunningTime="2026-10-31 07:39:04.255643443 +0000 UTC m=+650.902642727" Oct 31 07:39:04.257912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.257883 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbz8\" (UniqueName: \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.258066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.257947 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.258694 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.258672 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.275722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.275687 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbz8\" (UniqueName: \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\") pod \"payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.348586 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.348556 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:04.668227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:04.668197 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:39:04.671760 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:39:04.671729 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6c9bb5_a5b8_40cf_b1ab_07c7616a0b05.slice/crio-bf4ab8d79df0989b17335760bc45f4c311208b088741152c4f97ee40075d3029 WatchSource:0}: Error finding container bf4ab8d79df0989b17335760bc45f4c311208b088741152c4f97ee40075d3029: Status 404 returned error can't find the container with id bf4ab8d79df0989b17335760bc45f4c311208b088741152c4f97ee40075d3029 Oct 31 07:39:05.229497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.229325 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" event={"ID":"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05","Type":"ContainerStarted","Data":"95c2bac7b50f6463243794ba67759dfac0245b45383b76fc97ba03646d816d5c"} Oct 31 07:39:05.229497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.229380 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" event={"ID":"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05","Type":"ContainerStarted","Data":"bf4ab8d79df0989b17335760bc45f4c311208b088741152c4f97ee40075d3029"} Oct 31 07:39:05.230082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.229581 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:05.267655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.267595 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" podStartSLOduration=2.267575656 podStartE2EDuration="2.267575656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:05.265913295 +0000 UTC m=+651.912912577" watchObservedRunningTime="2026-10-31 07:39:05.267575656 +0000 UTC m=+651.914574940" Oct 31 07:39:05.307298 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.304861 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:39:05.309418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.309382 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.326023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.325994 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-4794f5-serving-cert\"" Oct 31 07:39:05.328599 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.328573 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:39:05.385054 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.385015 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblsw\" (UniqueName: \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.385391 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.385367 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.385982 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.385939 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.386083 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.386046 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.487314 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.487223 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.487486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.487316 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.487486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.487372 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.487666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.487553 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lblsw\" (UniqueName: \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.488103 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.488068 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.490062 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.490034 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.490170 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.490069 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.506440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.506408 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblsw\" (UniqueName: \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\") pod \"maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.625331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.625291 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:05.941971 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:05.941945 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:39:05.945505 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:39:05.945462 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834dcb5d_ac7f_4072_9088_7f1e87b91869.slice/crio-655402a2e19fb99ffc2f822919c88ad9d5382c965f2e5fc90f52d309b29097c6 WatchSource:0}: Error finding container 655402a2e19fb99ffc2f822919c88ad9d5382c965f2e5fc90f52d309b29097c6: Status 404 returned error can't find the container with id 655402a2e19fb99ffc2f822919c88ad9d5382c965f2e5fc90f52d309b29097c6 Oct 31 07:39:06.071422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:06.071382 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:39:06.071587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:06.071444 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:39:06.192163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:06.192092 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:39:06.242372 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:06.242341 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" event={"ID":"834dcb5d-ac7f-4072-9088-7f1e87b91869","Type":"ContainerStarted","Data":"655402a2e19fb99ffc2f822919c88ad9d5382c965f2e5fc90f52d309b29097c6"} Oct 31 07:39:07.250486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:07.250453 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" event={"ID":"834dcb5d-ac7f-4072-9088-7f1e87b91869","Type":"ContainerStarted","Data":"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0"} Oct 31 07:39:07.250958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:07.250684 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:08.256849 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.256810 4406 generic.go:356] "Generic (PLEG): container finished" podID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerID="723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb" exitCode=0 Oct 31 07:39:08.257359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.256878 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerDied","Data":"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb"} Oct 31 07:39:08.257359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.257312 4406 scope.go:122] "RemoveContainer" containerID="723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb" Oct 31 07:39:08.258577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.258547 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:08.258674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.258618 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:08.258674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.258651 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:08.334336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:08.318482 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" podStartSLOduration=3.03398229 podStartE2EDuration="3.318461249s" totalImagesPullingTime="284.478959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:07.331657269 +0000 UTC m=+653.978656563" watchObservedRunningTime="2026-10-31 07:39:08.318461249 +0000 UTC m=+654.965460530" Oct 31 07:39:09.264716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:09.264673 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerStarted","Data":"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf"} Oct 31 07:39:09.970262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:09.970222 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:39:09.970540 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:09.970513 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Oct 31 07:39:09.970616 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:09.970575 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Oct 31 07:39:09.994987 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:39:09.994947 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:39:10.970553 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:10.970512 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Oct 31 07:39:10.970940 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:10.970575 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Oct 31 07:39:11.969988 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:11.969950 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Oct 31 07:39:11.970206 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:11.970004 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Oct 31 07:39:12.972023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:12.971369 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Oct 31 07:39:12.972023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:12.971430 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Oct 31 07:39:13.284828 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:13.284678 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:39:13.969727 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:13.969684 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Oct 31 07:39:13.969912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:13.969753 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Oct 31 07:39:14.535608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.535277 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:39:14.543440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.543413 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.556755 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.556733 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:39:14.565362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.565309 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-b4e8fd-serving-cert\"" Oct 31 07:39:14.629905 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.629858 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.630178 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.630157 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.630359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.630342 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.630493 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.630478 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9sgw\" (UniqueName: \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.731700 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.731659 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9sgw\" (UniqueName: \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.731882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.731777 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.731882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.731843 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.732031 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.731897 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.732555 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.732529 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.734299 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.734275 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.734383 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.734319 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.747940 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.747915 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9sgw\" (UniqueName: \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\") pod \"maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.858776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.858731 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:14.973534 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.973505 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:39:14.973912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.973890 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:39:14.974612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:14.974590 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:39:15.177882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:15.177799 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:39:15.181737 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:39:15.181711 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34da9ae7_38cb_42f8_8d6e_8719e42340f6.slice/crio-6ea327053d11c7acc6427a0cfa7cefe215fb414967d5c6220f100f9271082c6f WatchSource:0}: Error finding container 6ea327053d11c7acc6427a0cfa7cefe215fb414967d5c6220f100f9271082c6f: Status 404 returned error can't find the container with id 6ea327053d11c7acc6427a0cfa7cefe215fb414967d5c6220f100f9271082c6f Oct 31 07:39:15.232597 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:15.232570 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:39:15.337810 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:15.337772 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" event={"ID":"34da9ae7-38cb-42f8-8d6e-8719e42340f6","Type":"ContainerStarted","Data":"6ea327053d11c7acc6427a0cfa7cefe215fb414967d5c6220f100f9271082c6f"} Oct 31 07:39:16.344674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:16.344625 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" event={"ID":"34da9ae7-38cb-42f8-8d6e-8719e42340f6","Type":"ContainerStarted","Data":"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3"} Oct 31 07:39:16.345143 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:16.344718 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:16.380841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:16.380789 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" podStartSLOduration=2.037512712 podStartE2EDuration="2.380761657s" totalImagesPullingTime="343.248945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:16.37876842 +0000 UTC m=+663.025767703" watchObservedRunningTime="2026-10-31 07:39:16.380761657 +0000 UTC m=+663.027760937" Oct 31 07:39:17.253492 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:17.253457 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:39:22.077428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.077384 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:39:22.077954 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.077450 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:39:22.355786 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.355722 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:39:22.379920 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.379833 4406 generic.go:356] "Generic (PLEG): container finished" podID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerID="e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380" exitCode=0 Oct 31 07:39:22.380066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.379919 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerDied","Data":"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380"} Oct 31 07:39:22.380391 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.380365 4406 scope.go:122] "RemoveContainer" containerID="e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380" Oct 31 07:39:22.381796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.381763 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:22.381922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.381849 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:22.381922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:22.381897 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:23.386870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:23.386828 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerStarted","Data":"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086"} Oct 31 07:39:23.571488 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:23.571455 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:39:23.571686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:23.571491 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:23.571686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:23.571542 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:24.572122 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:24.572076 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:24.572647 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:24.572191 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:25.571566 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:25.571485 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:25.571822 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:25.571789 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:26.572149 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:26.572060 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:26.572740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:26.572710 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:27.571500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:27.571463 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:27.571702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:27.571513 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:28.572170 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:28.572134 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 31 07:39:28.572682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:28.572203 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 31 07:39:29.575034 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:29.575006 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:39:29.575588 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:29.575443 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:39:29.576015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:29.575995 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:39:30.445220 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.445182 4406 generic.go:356] "Generic (PLEG): container finished" podID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerID="2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b" exitCode=0 Oct 31 07:39:30.445428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.445274 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerDied","Data":"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b"} Oct 31 07:39:30.445764 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.445748 4406 scope.go:122] "RemoveContainer" containerID="2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b" Oct 31 07:39:30.446985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.446956 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:30.447051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.447030 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:30.447095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:30.447080 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:39:31.453191 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:31.453155 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerStarted","Data":"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8"} Oct 31 07:39:32.218467 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:32.218435 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:39:32.226297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:32.220345 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Oct 31 07:39:32.226297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:32.220402 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Oct 31 07:39:33.207666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:33.207629 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Oct 31 07:39:33.208227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:33.208195 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Oct 31 07:39:34.209276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:34.208725 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Oct 31 07:39:34.209276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:34.208815 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Oct 31 07:39:35.035378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:35.035345 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:39:35.217376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:35.217337 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Oct 31 07:39:35.217923 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:35.217894 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Oct 31 07:39:36.215378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:36.215342 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Oct 31 07:39:36.215652 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:36.215623 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Oct 31 07:39:37.210634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:37.210603 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:39:37.211636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:37.211614 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:39:39.993367 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:39:39.993330 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:39:50.496420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.496385 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:39:50.501568 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.501544 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.516028 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.516000 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:39:50.524526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.524501 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"kube-root-ca.crt\"" Oct 31 07:39:50.524526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.524501 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"openshift-service-ca.crt\"" Oct 31 07:39:50.524723 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.524629 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"default-dockercfg-zgsvr\"" Oct 31 07:39:50.526280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.526245 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"simulator-w0-648fbe-kserve-self-signed-certs\"" Oct 31 07:39:50.656882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.656840 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.657054 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.656918 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.657054 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.657017 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.657132 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.657088 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.657132 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.657122 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nzt\" (UniqueName: \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.657208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.657188 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.758777 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758691 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.758777 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758767 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.759003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758799 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.759003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758846 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.759003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758872 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nzt\" (UniqueName: \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.759003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.758910 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.759381 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.759359 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.760547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.760517 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.760899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.760875 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.765929 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.765886 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.776688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.776597 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.783306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.783207 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nzt\" (UniqueName: \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\") pod \"simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:50.820961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:50.820926 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:39:51.120602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:51.120566 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:39:51.124177 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:39:51.124149 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4ec4c4c_6e04_4a78_80a2_fabb6e9a72b4.slice/crio-04107f56832aab68b4c8c57ac84c3188f47a535752e06ae2a78d07440533a771 WatchSource:0}: Error finding container 04107f56832aab68b4c8c57ac84c3188f47a535752e06ae2a78d07440533a771: Status 404 returned error can't find the container with id 04107f56832aab68b4c8c57ac84c3188f47a535752e06ae2a78d07440533a771 Oct 31 07:39:51.577289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:51.577171 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" event={"ID":"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4","Type":"ContainerStarted","Data":"ba8b73a449f294b4d039bc4fa79dcd4fbcce80dfe8ef9a368586270551859cc8"} Oct 31 07:39:51.577289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:51.577213 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" event={"ID":"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4","Type":"ContainerStarted","Data":"04107f56832aab68b4c8c57ac84c3188f47a535752e06ae2a78d07440533a771"} Oct 31 07:39:51.821739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:39:51.821708 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:40:00.821600 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:00.821542 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:40:00.834307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:00.834281 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:40:00.869451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:00.869398 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podStartSLOduration=10.8693851 podStartE2EDuration="10.8693851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:51.614002915 +0000 UTC m=+698.261002195" watchObservedRunningTime="2026-10-31 07:40:00.8693851 +0000 UTC m=+707.516384371" Oct 31 07:40:01.643770 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:01.643744 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:40:05.319089 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.319049 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:40:05.322612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.322590 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.345503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.345466 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"kube-root-ca.crt\"" Oct 31 07:40:05.346426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.345789 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"premium-w1-4794f5-kserve-self-signed-certs\"" Oct 31 07:40:05.346426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.345805 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"default-dockercfg-qtnhp\"" Oct 31 07:40:05.346426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.345844 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"openshift-service-ca.crt\"" Oct 31 07:40:05.349099 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.349071 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:40:05.446562 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446523 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.446740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446644 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.446782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446731 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrvhn\" (UniqueName: \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.446816 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446796 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.446898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446882 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.446937 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.446919 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.547823 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.547892 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrvhn\" (UniqueName: \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.547955 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.548043 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.548091 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.548272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.548203 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.567276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.548716 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.567276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.548976 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.567276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.550087 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.567276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.566439 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.571313 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.569115 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.576140 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.576106 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrvhn\" (UniqueName: \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\") pod \"premium-w1-4794f5-kserve-58864d75bb-jf9dr\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.639653 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.639620 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:05.934181 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:05.934145 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:40:05.937457 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:40:05.937389 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a8269e_a81e_413d_b354_adbb5ff46faa.slice/crio-c6bd25a7f03fb5e48c4e804bf5d782934e2eaacd3e239defe18e90c7838adbab WatchSource:0}: Error finding container c6bd25a7f03fb5e48c4e804bf5d782934e2eaacd3e239defe18e90c7838adbab: Status 404 returned error can't find the container with id c6bd25a7f03fb5e48c4e804bf5d782934e2eaacd3e239defe18e90c7838adbab Oct 31 07:40:06.662437 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:06.662396 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" event={"ID":"36a8269e-a81e-413d-b354-adbb5ff46faa","Type":"ContainerStarted","Data":"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33"} Oct 31 07:40:06.662437 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:06.662448 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" event={"ID":"36a8269e-a81e-413d-b354-adbb5ff46faa","Type":"ContainerStarted","Data":"c6bd25a7f03fb5e48c4e804bf5d782934e2eaacd3e239defe18e90c7838adbab"} Oct 31 07:40:06.701275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:06.700288 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podStartSLOduration=1.700238756 podStartE2EDuration="1.700238756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:06.6987382 +0000 UTC m=+713.345737506" watchObservedRunningTime="2026-10-31 07:40:06.700238756 +0000 UTC m=+713.347238039" Oct 31 07:40:07.640279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:07.640236 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:10.004338 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:40:10.004302 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:40:15.640475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:15.640431 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:15.654302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:15.654278 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:15.718749 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:15.718722 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:40:26.197507 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.197470 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:40:26.202926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.202900 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.219318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.219275 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:40:26.227176 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.227151 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"premium-w0-648fbe-kserve-self-signed-certs\"" Oct 31 07:40:26.324932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.324893 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.325127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.324946 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5w5\" (UniqueName: \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.325127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.325086 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.325127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.325121 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.325375 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.325357 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.325431 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.325408 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.427154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.427115 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.427951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.427921 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.427845 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.428414 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.428671 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428749 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.428706 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5w5\" (UniqueName: \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428803 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.428765 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.428803 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.428790 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.429330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.429308 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.431926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.431900 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.432120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.432102 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.446487 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.446461 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5w5\" (UniqueName: \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\") pod \"premium-w0-648fbe-kserve-dcf7b474f-28g2r\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.518448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.518349 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:26.818678 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:26.818588 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:40:26.822042 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:40:26.822009 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92673a3d_d247_4c5a_8f17_92dd469d9a61.slice/crio-b447e285134e442a2853ffe3466a08bc37b0d25b94a37ace72494bc6fe968d36 WatchSource:0}: Error finding container b447e285134e442a2853ffe3466a08bc37b0d25b94a37ace72494bc6fe968d36: Status 404 returned error can't find the container with id b447e285134e442a2853ffe3466a08bc37b0d25b94a37ace72494bc6fe968d36 Oct 31 07:40:27.771825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:27.771776 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" event={"ID":"92673a3d-d247-4c5a-8f17-92dd469d9a61","Type":"ContainerStarted","Data":"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db"} Oct 31 07:40:27.771825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:27.771826 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" event={"ID":"92673a3d-d247-4c5a-8f17-92dd469d9a61","Type":"ContainerStarted","Data":"b447e285134e442a2853ffe3466a08bc37b0d25b94a37ace72494bc6fe968d36"} Oct 31 07:40:27.808365 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:27.808309 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podStartSLOduration=1.8082940490000001 podStartE2EDuration="1.808294049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:27.807956476 +0000 UTC m=+734.454955757" watchObservedRunningTime="2026-10-31 07:40:27.808294049 +0000 UTC m=+734.455293351" Oct 31 07:40:28.519234 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:28.519199 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:33.408067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.408029 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:40:33.411885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.411856 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.435322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.435292 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-b1fda4-openshift-default-dockercfg-9xncc\"" Oct 31 07:40:33.439000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.438972 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:40:33.504049 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504017 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504071 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504246 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504226 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504321 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504284 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c2q\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504348 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504466 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504559 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504595 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.504757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.504621 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606151 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606457 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606239 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606457 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606297 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606457 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606373 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606457 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606414 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606459 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606486 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c2q\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606542 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606599 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.606848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.606732 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.607395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.607033 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.607395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.607072 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.607618 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.607482 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.607945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.607913 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.609418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.609389 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.609630 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.609611 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.624135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.624107 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.624455 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.624438 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c2q\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:33.725776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:33.725694 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:34.036161 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.036059 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:40:34.039201 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:40:34.039173 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e63e3d5_033c_4870_a00f_3fc867b8ae41.slice/crio-5a1c978cf473c81ddcb9cc5509e52486e0291cfe302e9ee57861edc227936304 WatchSource:0}: Error finding container 5a1c978cf473c81ddcb9cc5509e52486e0291cfe302e9ee57861edc227936304: Status 404 returned error can't find the container with id 5a1c978cf473c81ddcb9cc5509e52486e0291cfe302e9ee57861edc227936304 Oct 31 07:40:34.041587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.041545 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:34.041707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.041619 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:34.041707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.041655 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:34.823024 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.822984 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" event={"ID":"5e63e3d5-033c-4870-a00f-3fc867b8ae41","Type":"ContainerStarted","Data":"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1"} Oct 31 07:40:34.823654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.823630 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" event={"ID":"5e63e3d5-033c-4870-a00f-3fc867b8ae41","Type":"ContainerStarted","Data":"5a1c978cf473c81ddcb9cc5509e52486e0291cfe302e9ee57861edc227936304"} Oct 31 07:40:34.877751 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:34.877700 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podStartSLOduration=1.87768224 podStartE2EDuration="1.87768224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:34.875833114 +0000 UTC m=+741.522832398" watchObservedRunningTime="2026-10-31 07:40:34.87768224 +0000 UTC m=+741.524681525" Oct 31 07:40:35.731468 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:35.731436 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:35.734378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:35.734347 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Oct 31 07:40:35.734579 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:35.734553 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Oct 31 07:40:36.527473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:36.527385 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:36.540446 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:36.540420 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:36.729341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:36.728655 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Oct 31 07:40:36.729341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:36.728732 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Oct 31 07:40:36.847779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:36.847752 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:40:37.734739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:37.726673 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Oct 31 07:40:37.734739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:37.726737 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Oct 31 07:40:38.729276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:38.728607 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Oct 31 07:40:38.729276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:38.728680 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Oct 31 07:40:39.731637 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:39.731587 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Oct 31 07:40:39.732136 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:39.731663 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Oct 31 07:40:39.991687 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:40:39.991584 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:40:40.730475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:40.730434 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:40.730835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:40.730814 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:40.731529 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:40.731512 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:40:48.676424 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.676391 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:40:48.681357 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.681336 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.697014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.696994 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-4794f5-openshift-default-dockercfg-lqf5r\"" Oct 31 07:40:48.710842 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.710807 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:40:48.848146 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848109 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848159 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848236 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848516 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848360 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5bpx\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848516 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848405 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848516 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848507 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848642 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848549 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848625 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.848741 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.848724 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.949833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949743 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.949833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949793 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5bpx\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.949833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949815 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949842 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949870 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949901 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.949966 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950169 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950276 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950210 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950781 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950788 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950990 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950881 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.950990 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.950900 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.952332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.952312 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.953141 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.953123 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.966484 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.966459 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.966626 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.966607 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5bpx\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:48.994976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:48.994943 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:49.314772 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.314743 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:40:49.317353 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:40:49.317325 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388ef355_43a5_4c5a_aad8_dee28b02d32f.slice/crio-12329385621c442de94e49436326cef68d9eff82f68417ad374230883c7b9cfc WatchSource:0}: Error finding container 12329385621c442de94e49436326cef68d9eff82f68417ad374230883c7b9cfc: Status 404 returned error can't find the container with id 12329385621c442de94e49436326cef68d9eff82f68417ad374230883c7b9cfc Oct 31 07:40:49.319664 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.319630 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:49.319778 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.319690 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:49.319778 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.319718 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:40:49.934480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.934440 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" event={"ID":"388ef355-43a5-4c5a-aad8-dee28b02d32f","Type":"ContainerStarted","Data":"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725"} Oct 31 07:40:49.934882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.934504 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" event={"ID":"388ef355-43a5-4c5a-aad8-dee28b02d32f","Type":"ContainerStarted","Data":"12329385621c442de94e49436326cef68d9eff82f68417ad374230883c7b9cfc"} Oct 31 07:40:49.981502 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.981453 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podStartSLOduration=1.981440809 podStartE2EDuration="1.981440809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:49.980503063 +0000 UTC m=+756.627502345" watchObservedRunningTime="2026-10-31 07:40:49.981440809 +0000 UTC m=+756.628440091" Oct 31 07:40:49.995315 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:49.995286 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:50.997615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:50.997586 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Oct 31 07:40:50.998020 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:50.997640 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Oct 31 07:40:51.995829 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:51.995777 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Oct 31 07:40:51.996039 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:51.995854 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Oct 31 07:40:52.995994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:52.995957 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Oct 31 07:40:52.996380 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:52.996020 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Oct 31 07:40:53.996211 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:53.996176 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Oct 31 07:40:53.996635 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:53.996240 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Oct 31 07:40:54.996463 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:54.996429 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Oct 31 07:40:54.996954 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:54.996492 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Oct 31 07:40:56.019146 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:56.019106 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:56.019939 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:56.019918 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:40:56.021111 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:40:56.021042 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:41:09.993902 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:41:09.993861 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:41:39.993080 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:41:39.993048 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:41:41.666267 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.666228 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 07:41:41.670359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.670334 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.696299 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.696270 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 07:41:41.844239 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844196 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcts\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844271 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844375 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844416 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844477 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844527 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844546 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844569 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.844627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.844587 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945494 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945395 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945494 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945463 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945586 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945639 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945724 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945672 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945724 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcts\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945762 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945827 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945834 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.945889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.945873 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.946141 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.946002 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.946196 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.946177 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.946309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.946283 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.946564 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.946545 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.948358 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.948335 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.948542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.948524 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.965713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.965689 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.966875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.966857 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcts\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\") pod \"maas-default-gateway-openshift-default-645cf464d7-lq99r\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:41.982896 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:41.982878 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:42.295338 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:42.295246 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 07:41:42.300732 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:41:42.300698 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36384417_7e09_4b91_b76f_6ead111f67d6.slice/crio-6ee2ea869fd985e31577daf504762f957b596ac80525deb9db4fd2ada2d92e1c WatchSource:0}: Error finding container 6ee2ea869fd985e31577daf504762f957b596ac80525deb9db4fd2ada2d92e1c: Status 404 returned error can't find the container with id 6ee2ea869fd985e31577daf504762f957b596ac80525deb9db4fd2ada2d92e1c Oct 31 07:41:42.304787 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:42.304743 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:42.304905 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:42.304835 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:42.304905 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:42.304880 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:43.247888 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.247853 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" event={"ID":"36384417-7e09-4b91-b76f-6ead111f67d6","Type":"ContainerStarted","Data":"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6"} Oct 31 07:41:43.248327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.247937 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" event={"ID":"36384417-7e09-4b91-b76f-6ead111f67d6","Type":"ContainerStarted","Data":"6ee2ea869fd985e31577daf504762f957b596ac80525deb9db4fd2ada2d92e1c"} Oct 31 07:41:43.339312 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.336564 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podStartSLOduration=2.336542764 podStartE2EDuration="2.336542764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:43.300060383 +0000 UTC m=+809.947059664" watchObservedRunningTime="2026-10-31 07:41:43.336542764 +0000 UTC m=+809.983542046" Oct 31 07:41:43.985109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.985072 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:43.986446 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.986401 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:43.986677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:43.986640 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:44.983479 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:44.983439 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:44.983953 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:44.983521 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:45.984138 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:45.984097 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:45.984663 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:45.984168 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:46.984080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:46.984043 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:46.984664 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:46.984623 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:47.984987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:47.984361 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:47.984987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:47.984435 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:48.233361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.233323 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:41:48.240472 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.240399 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.266063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.266026 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-027d2a-openshift-default-dockercfg-7m2tr\"" Oct 31 07:41:48.269216 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.269189 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:41:48.386548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386517 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.386548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386553 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.386771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386586 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.386826 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386755 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.386886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386825 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.386940 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386915 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dch56\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.387006 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.386957 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.387069 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.387051 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.387121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.387081 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488145 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488190 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488219 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488289 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488342 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488382 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dch56\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488406 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488453 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488479 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488790 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488736 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488821 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488869 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.488900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.488883 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.489738 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.489708 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.490732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.490676 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.490975 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.490955 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.505637 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.505609 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.506082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.506058 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dch56\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.558430 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.558401 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:48.883968 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.883938 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:41:48.885956 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:41:48.885929 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683d414d_d5d2_4e12_8384_682017ac615b.slice/crio-029cfcf239bb69da50ddccc886c531e6e75020978f19d7d6f7355b64dc2bdb7a WatchSource:0}: Error finding container 029cfcf239bb69da50ddccc886c531e6e75020978f19d7d6f7355b64dc2bdb7a: Status 404 returned error can't find the container with id 029cfcf239bb69da50ddccc886c531e6e75020978f19d7d6f7355b64dc2bdb7a Oct 31 07:41:48.888835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.888794 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:48.888921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.888883 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:48.888966 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.888929 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:41:48.983791 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.983750 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:48.983961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:48.983818 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:49.306856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.302906 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" event={"ID":"683d414d-d5d2-4e12-8384-682017ac615b","Type":"ContainerStarted","Data":"150838c74a9fca3b299542ce95a29933ee9464537327883ad44aa4fe95460c45"} Oct 31 07:41:49.306856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.302975 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" event={"ID":"683d414d-d5d2-4e12-8384-682017ac615b","Type":"ContainerStarted","Data":"029cfcf239bb69da50ddccc886c531e6e75020978f19d7d6f7355b64dc2bdb7a"} Oct 31 07:41:49.366477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.364573 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podStartSLOduration=1.364548851 podStartE2EDuration="1.364548851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:49.350631332 +0000 UTC m=+815.997630632" watchObservedRunningTime="2026-10-31 07:41:49.364548851 +0000 UTC m=+816.011548133" Oct 31 07:41:49.558937 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.558843 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:49.561452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.561420 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:49.561620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.561479 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:49.983826 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.983786 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 07:41:49.983970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:49.983848 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 07:41:50.559981 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:50.559217 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:50.559981 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:50.559295 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:51.443932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:51.443894 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:51.444374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:51.444285 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:51.445121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:51.445090 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 07:41:51.559737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:51.559617 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:51.559737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:51.559677 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:52.558952 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:52.558914 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:52.559459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:52.558985 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:53.558775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:53.558740 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:53.558984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:53.558830 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:54.559751 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:54.559702 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Oct 31 07:41:54.560245 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:54.559772 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Oct 31 07:41:55.569030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:55.568979 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:55.569789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:55.569765 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:41:55.570656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:41:55.570636 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:42:03.640330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.640293 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:42:03.644639 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.644615 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.662630 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.662605 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:42:03.776985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.776951 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb9bc\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.776995 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777014 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777179 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777244 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777278 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777311 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777446 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.777497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.777477 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879060 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879028 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879088 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879111 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879143 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879212 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879244 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879309 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb9bc\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879508 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879563 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879612 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.879697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879644 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.880010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.879993 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.880110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.880051 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.880205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.880184 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.882052 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.882029 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.882504 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.882480 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.895984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.895925 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.896400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.896381 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb9bc\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:03.958678 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:03.958644 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:04.270756 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.270678 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:42:04.279957 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.279916 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:04.280063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.280010 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:04.280063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.280054 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:04.457599 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.457547 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" event={"ID":"3a50b861-b673-406c-9a55-e27a5261bc29","Type":"ContainerStarted","Data":"63500db1619d9c8ccccc7c60570c62265ab9fea8fb7ed621e7dea0e234870aca"} Oct 31 07:42:04.457831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.457631 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" event={"ID":"3a50b861-b673-406c-9a55-e27a5261bc29","Type":"ContainerStarted","Data":"39c9054f27a6af68d383aedf56f3d5fa467ee696c0f184b0c1da8542f67c1247"} Oct 31 07:42:04.496659 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.496587 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podStartSLOduration=1.496565897 podStartE2EDuration="1.496565897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:04.493129161 +0000 UTC m=+831.140128443" watchObservedRunningTime="2026-10-31 07:42:04.496565897 +0000 UTC m=+831.143565181" Oct 31 07:42:04.958791 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:04.958752 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:05.960713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:05.960674 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:05.961206 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:05.960731 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:06.958985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:06.958951 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:06.959186 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:06.959008 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:07.959395 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:07.959360 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:07.959800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:07.959417 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:08.959572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:08.959532 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:08.959983 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:08.959592 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:09.959811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:09.959768 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:09.960359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:09.959831 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:09.997054 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:42:09.997014 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:42:10.958274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:10.957320 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:42:10.995819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:10.992781 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.010552 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.003743 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 31 07:42:11.010552 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.003827 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 31 07:42:11.020937 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.019433 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-648fbe\"/\"distinct-w0-648fbe-kserve-self-signed-certs\"" Oct 31 07:42:11.021690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.021534 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114029 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114136 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114188 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnsj5\" (UniqueName: \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114297 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114330 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.124545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.114367 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.216215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.216121 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.217085 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.217058 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.217715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.217611 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.217898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.217880 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnsj5\" (UniqueName: \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.238352 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.238314 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.239369 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.239347 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.239986 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.239765 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.240747 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.240616 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.240871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.240855 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.259737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.259707 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnsj5\" (UniqueName: \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.278878 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.278839 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.280859 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.280801 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\") pod \"distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.434798 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.434534 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:11.979274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.978705 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:11.986016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.980198 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:11.986016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:11.984413 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:42:12.018330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:12.018293 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:42:12.024635 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:42:12.024564 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8901f4dc_b37c_4996_8847_75b2d5a0367e.slice/crio-fd83595efd73a0a846623d61af58f4092dee74dea04c60e001e350343f4dcd89 WatchSource:0}: Error finding container fd83595efd73a0a846623d61af58f4092dee74dea04c60e001e350343f4dcd89: Status 404 returned error can't find the container with id fd83595efd73a0a846623d61af58f4092dee74dea04c60e001e350343f4dcd89 Oct 31 07:42:12.526600 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:12.526559 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" event={"ID":"8901f4dc-b37c-4996-8847-75b2d5a0367e","Type":"ContainerStarted","Data":"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26"} Oct 31 07:42:12.526787 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:12.526615 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" event={"ID":"8901f4dc-b37c-4996-8847-75b2d5a0367e","Type":"ContainerStarted","Data":"fd83595efd73a0a846623d61af58f4092dee74dea04c60e001e350343f4dcd89"} Oct 31 07:42:12.563531 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:12.563487 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podStartSLOduration=2.563474387 podStartE2EDuration="2.563474387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:12.563221037 +0000 UTC m=+839.210220319" watchObservedRunningTime="2026-10-31 07:42:12.563474387 +0000 UTC m=+839.210473667" Oct 31 07:42:13.435652 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:13.435622 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:18.451825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.451771 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:42:18.456228 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.456210 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.475441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.475413 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:42:18.567120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567088 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567124 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567143 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567160 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567325 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567437 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567415 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567470 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567438 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567532 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.567580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.567561 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs652\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.668643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668610 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.668805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668702 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.668805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668725 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.668805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668762 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.668805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668794 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs652\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668839 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668863 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668893 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669036 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.668917 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669239 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.669166 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.669234 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.669523 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.669529 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.669620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.669592 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.671010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.670981 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.671261 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.671230 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.690072 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.690042 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs652\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.690685 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.690668 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:18.769715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:18.769627 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:19.108528 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.108500 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:42:19.111354 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:42:19.111323 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6c54a2_9f4f_4a94_924b_fecc579f24f1.slice/crio-e7d663bdbd8afa1f8c382af1b14d9d1c3702a0a6211c39d490a3242b0a646da5 WatchSource:0}: Error finding container e7d663bdbd8afa1f8c382af1b14d9d1c3702a0a6211c39d490a3242b0a646da5: Status 404 returned error can't find the container with id e7d663bdbd8afa1f8c382af1b14d9d1c3702a0a6211c39d490a3242b0a646da5 Oct 31 07:42:19.113695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.113661 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:19.113796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.113727 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:19.113796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.113755 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:19.575728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.575639 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" event={"ID":"0e6c54a2-9f4f-4a94-924b-fecc579f24f1","Type":"ContainerStarted","Data":"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200"} Oct 31 07:42:19.576317 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.576244 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" event={"ID":"0e6c54a2-9f4f-4a94-924b-fecc579f24f1","Type":"ContainerStarted","Data":"e7d663bdbd8afa1f8c382af1b14d9d1c3702a0a6211c39d490a3242b0a646da5"} Oct 31 07:42:19.770440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:19.770408 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:20.771084 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:20.771046 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 31 07:42:20.771570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:20.771108 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 31 07:42:21.435607 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.435571 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:21.448791 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.448764 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:21.484088 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.483944 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podStartSLOduration=3.483927407 podStartE2EDuration="3.483927407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:19.619657258 +0000 UTC m=+846.266656541" watchObservedRunningTime="2026-10-31 07:42:21.483927407 +0000 UTC m=+848.130926692" Oct 31 07:42:21.599622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.599590 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:42:21.770615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.770524 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 31 07:42:21.770786 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:21.770605 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 31 07:42:22.770429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:22.770397 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 31 07:42:22.770812 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:22.770462 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 31 07:42:23.769960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:23.769922 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 31 07:42:23.770166 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:23.769985 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 31 07:42:24.770785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:24.770750 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 31 07:42:24.771269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:24.770803 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 31 07:42:25.991778 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:25.991742 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:25.992746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:25.992719 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:25.993896 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:25.993873 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:42:33.261053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.261024 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:42:33.264902 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.264882 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.284282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.284226 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:42:33.359471 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.359439 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:42:33.363351 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.363333 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.366413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366381 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366512 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366423 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366551 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366514 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366607 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366741 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366725 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366857 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366935 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366922 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.366970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366956 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.367002 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.366987 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dkn\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.383947 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.383914 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:42:33.467771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.467740 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.467948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.467782 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.467948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.467812 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvnd\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.467948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.467923 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468052 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468015 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468048 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468078 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468173 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468113 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468173 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468125 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468173 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468152 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468173 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468170 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468199 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dkn\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468336 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468356 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468390 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468411 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468447 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468492 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468515 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.468697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468565 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468588 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.468960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468711 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.469016 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.468993 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.470812 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.470780 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.471149 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.471127 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.485556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.485529 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.485666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.485643 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dkn\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.569610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569523 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569566 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvnd\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569627 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569711 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569756 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569784 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.569837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569814 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569928 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569953 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.569952 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.570239 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570382 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.570357 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.570573 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.570656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.570636 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.572693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.572669 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.572789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.572671 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.579017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.578996 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:33.587912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.587888 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.587912 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.587902 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvnd\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.608174 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.608144 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:42:33.613579 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.613559 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.649269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.630722 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-3dff3f-openshift-default-dockercfg-8q5cz\"" Oct 31 07:42:33.649269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.631198 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:42:33.671493 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671462 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t67m\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671512 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671534 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671555 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671627 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671574 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671713 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671751 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671784 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.671835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.671821 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.682478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.682258 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:33.775282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.775227 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.775506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.775489 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.775655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.775640 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.775806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.775781 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.776019 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.776004 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t67m\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.776157 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.776144 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.776273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.776260 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.776415 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.776402 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.776514 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.776502 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.777849 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.777828 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.778212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.778194 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.778623 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.778604 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.778972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.778952 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.779356 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.779331 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.781897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.781880 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.784104 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.784078 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.794280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.794224 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.796790 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.796766 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t67m\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:33.907907 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.907874 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:42:33.911535 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:42:33.911503 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625c5412_1279_4bc1_8741_b8a7745dffd8.slice/crio-007b42ac03047f1bb34d34a425b030aeb89923762500ee52770b6169347821e5 WatchSource:0}: Error finding container 007b42ac03047f1bb34d34a425b030aeb89923762500ee52770b6169347821e5: Status 404 returned error can't find the container with id 007b42ac03047f1bb34d34a425b030aeb89923762500ee52770b6169347821e5 Oct 31 07:42:33.913941 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.913902 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:33.914042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.913971 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:33.914042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.914001 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:33.928988 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:33.928964 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:34.051697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.051660 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:42:34.064658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.060441 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.064658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.060528 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.064658 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.060570 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.247624 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.247073 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:42:34.253082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.253033 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.253199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.253113 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.253199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.253161 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:42:34.885898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.885855 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" event={"ID":"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d","Type":"ContainerStarted","Data":"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d"} Oct 31 07:42:34.885898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.885907 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" event={"ID":"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d","Type":"ContainerStarted","Data":"f09b32d60cfbdca582f094e24e1868a76c4397a9f843ae94c8c16d4ccaee030b"} Oct 31 07:42:34.888790 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.888763 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" event={"ID":"3e521f36-93c6-4a5e-96d9-b8e075d7245f","Type":"ContainerStarted","Data":"fd86c96e01d4d86f4c761a9b181a7dbe5a1a82e35274cf7e42714c37126b5dfc"} Oct 31 07:42:34.889015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.888985 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" event={"ID":"3e521f36-93c6-4a5e-96d9-b8e075d7245f","Type":"ContainerStarted","Data":"b25e7de57fbd29eef6f7fd62a5cb364a9e25095b27676e6ec4aa27cff858d864"} Oct 31 07:42:34.890974 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.890931 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" event={"ID":"625c5412-1279-4bc1-8741-b8a7745dffd8","Type":"ContainerStarted","Data":"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2"} Oct 31 07:42:34.891111 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.890996 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" event={"ID":"625c5412-1279-4bc1-8741-b8a7745dffd8","Type":"ContainerStarted","Data":"007b42ac03047f1bb34d34a425b030aeb89923762500ee52770b6169347821e5"} Oct 31 07:42:34.930830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.928962 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podStartSLOduration=1.9289400209999998 podStartE2EDuration="1.928940021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:34.926570773 +0000 UTC m=+861.573570055" watchObservedRunningTime="2026-10-31 07:42:34.928940021 +0000 UTC m=+861.575939303" Oct 31 07:42:34.930830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.930330 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:34.969399 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:34.969337 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podStartSLOduration=1.96931656 podStartE2EDuration="1.96931656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:34.967871676 +0000 UTC m=+861.614870958" watchObservedRunningTime="2026-10-31 07:42:34.96931656 +0000 UTC m=+861.616315845" Oct 31 07:42:35.046274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.014204 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podStartSLOduration=2.01418244 podStartE2EDuration="2.01418244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:35.004754122 +0000 UTC m=+861.651753490" watchObservedRunningTime="2026-10-31 07:42:35.01418244 +0000 UTC m=+861.661181722" Oct 31 07:42:35.580615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.580565 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:35.582435 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.582381 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:35.582596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.582458 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:35.684281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.682942 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:35.689718 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.689686 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:35.689876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.689745 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:35.952334 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.949130 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:35.952334 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:35.949187 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:36.590738 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.590703 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:36.591004 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.590981 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:36.694275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.694006 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:36.694275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.694082 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:36.944332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.936370 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:36.944332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:36.936427 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:37.677295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.620405 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:37.677295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.620585 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:37.695277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.687676 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:37.695277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.687772 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:37.946331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.945672 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:37.946331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:37.945746 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:38.586055 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.579544 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:38.586055 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.579614 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:38.690729 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.690693 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:38.691356 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.691305 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:38.933733 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.933640 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:38.948155 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:38.948100 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:39.587732 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.587698 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:39.591743 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.591355 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:39.684611 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.684574 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:39.684889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.684861 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:39.930704 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.930616 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:39.931292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:39.931240 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:40.096713 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:42:40.096666 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:42:40.579452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.579420 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 31 07:42:40.579669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.579473 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 31 07:42:40.683942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.683905 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 31 07:42:40.684123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.683966 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 31 07:42:40.929501 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.929417 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 31 07:42:40.929501 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:40.929480 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 31 07:42:41.689669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.689634 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:41.691625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.691602 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:41.692620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.692600 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:42:41.769280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.766598 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:41.769280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.767879 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:41.786217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:41.786184 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:42:42.102766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:42.102735 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:42.104208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:42.104074 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:42.105824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:42.105799 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:42:48.597277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:48.591394 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:42:48.637461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:48.637402 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:42:48.721431 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:48.721374 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:42:48.837650 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:42:48.837554 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 31 07:43:03.807995 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.807962 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:43:03.812101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.812079 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.842448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.842416 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:43:03.875041 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875007 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875055 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875217 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875148 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875292 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875405 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875333 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875507 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875486 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875575 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875560 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875626 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875609 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjpc\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.875661 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.875650 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.976890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.976853 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.976890 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.976891 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.976911 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.976959 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.976982 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977033 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977092 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977130 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977124 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjpc\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977163 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977379 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977753 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977865 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977827 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.977865 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.977856 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.978057 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.978037 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.979621 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.979596 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.979754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.979653 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.994594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.994571 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:03.994754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:03.994732 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjpc\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:04.016669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.016639 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:43:04.022427 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.022403 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.048974 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.046764 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:43:04.078280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078037 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078218 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4vgg\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078296 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078384 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078406 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078468 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.078823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078797 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.079116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078872 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.079244 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.078940 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.139559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.139527 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.181777 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.181840 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.181874 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.181914 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.181985 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182023 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182083 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182689 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182235 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4vgg\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182689 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182306 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182759 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.182994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.182973 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.183537 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.183497 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.183739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.183720 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.186103 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.186080 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.212378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.206137 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.212378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.206436 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.213475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.213413 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.222619 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.222552 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4vgg\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.354930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.354852 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:04.510959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.510926 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:43:04.514817 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:04.514791 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a9ed28_11cb_4b5c_9616_01ddf2136d19.slice/crio-8e89baf90ba57d715a472f2893562daa7dde46638061261fd20727c80d22bbc1 WatchSource:0}: Error finding container 8e89baf90ba57d715a472f2893562daa7dde46638061261fd20727c80d22bbc1: Status 404 returned error can't find the container with id 8e89baf90ba57d715a472f2893562daa7dde46638061261fd20727c80d22bbc1 Oct 31 07:43:04.517731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.517695 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:04.517850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.517776 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:04.517850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.517826 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:04.667384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.666982 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:43:04.670127 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:04.670100 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563b40b1_4f56_49cb_a221_c29026e9fbed.slice/crio-75e0d3bd0af61b0233dba3cf37804a5db5b13f1253cfa89e15bd281e88fa43f4 WatchSource:0}: Error finding container 75e0d3bd0af61b0233dba3cf37804a5db5b13f1253cfa89e15bd281e88fa43f4: Status 404 returned error can't find the container with id 75e0d3bd0af61b0233dba3cf37804a5db5b13f1253cfa89e15bd281e88fa43f4 Oct 31 07:43:04.673559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.673525 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:04.673645 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.673591 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:04.673645 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:04.673621 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:05.292116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.292084 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" event={"ID":"563b40b1-4f56-49cb-a221-c29026e9fbed","Type":"ContainerStarted","Data":"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade"} Oct 31 07:43:05.292710 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.292681 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" event={"ID":"563b40b1-4f56-49cb-a221-c29026e9fbed","Type":"ContainerStarted","Data":"75e0d3bd0af61b0233dba3cf37804a5db5b13f1253cfa89e15bd281e88fa43f4"} Oct 31 07:43:05.293800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.293783 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" event={"ID":"f1a9ed28-11cb-4b5c-9616-01ddf2136d19","Type":"ContainerStarted","Data":"df111413f403b74fe4a452a423f419db29abacc7e8e859aae27281dcec46bbe1"} Oct 31 07:43:05.293923 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.293912 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" event={"ID":"f1a9ed28-11cb-4b5c-9616-01ddf2136d19","Type":"ContainerStarted","Data":"8e89baf90ba57d715a472f2893562daa7dde46638061261fd20727c80d22bbc1"} Oct 31 07:43:05.356468 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.356427 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:05.357810 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.357750 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podStartSLOduration=2.357733709 podStartE2EDuration="2.357733709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:05.346843798 +0000 UTC m=+891.993843081" watchObservedRunningTime="2026-10-31 07:43:05.357733709 +0000 UTC m=+892.004732993" Oct 31 07:43:05.358298 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.358273 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:05.358450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.358428 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:05.385208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:05.385161 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podStartSLOduration=2.385147343 podStartE2EDuration="2.385147343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:05.383996837 +0000 UTC m=+892.030996117" watchObservedRunningTime="2026-10-31 07:43:05.385147343 +0000 UTC m=+892.032146704" Oct 31 07:43:06.142496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:06.142467 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:06.142988 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:06.142961 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:06.143175 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:06.143144 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:06.362272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:06.361359 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:06.362272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:06.361420 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:07.141272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:07.140419 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:07.141272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:07.140477 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:07.360718 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:07.360654 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:07.360962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:07.360727 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:08.156048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:08.154292 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:08.156048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:08.154347 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:08.359738 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:08.359695 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:08.360022 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:08.359986 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:09.140769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:09.140733 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:09.141060 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:09.141027 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:09.356708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:09.356667 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:09.357450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:09.357407 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:09.992929 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:43:09.992894 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:43:10.142112 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:10.141664 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:10.142112 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:10.141729 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:10.359762 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:10.359710 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 31 07:43:10.360290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:10.359799 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 31 07:43:11.140698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:11.140658 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 31 07:43:11.140866 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:11.140729 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 31 07:43:11.575546 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:11.575455 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:11.576678 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:11.576654 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:11.578614 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:11.578596 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:43:12.310838 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:12.310808 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:12.312517 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:12.312192 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:12.313956 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:12.313902 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:43:18.754891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.754850 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:43:18.773271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.769995 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.792283 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.782509 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:43:18.943122 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.943062 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.943400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.943376 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.943539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.943510 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.943734 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.943715 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.943868 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.943854 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.944069 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.944052 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvgwt\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.944238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.944224 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.945610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.944436 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.945802 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.945782 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:18.986320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.970106 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:43:18.986320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:18.975296 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.003282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.003112 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:43:19.048844 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.048801 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.049833 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.049915 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.049949 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.049984 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050127 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050244 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050309 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050339 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050378 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050414 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfwh5\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050471 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050544 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgwt\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050573 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050658 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050690 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050762 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.050804 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.054989 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.055353 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.055926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.055573 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.057007 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.056265 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.057007 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.056513 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.058977 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.057096 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.064303 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.064274 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.072198 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.072173 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.072867 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.072824 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvgwt\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.114737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.114708 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152131 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfwh5\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152203 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152303 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152384 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152450 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152495 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152550 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152651 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152678 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152737 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.152902 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.153098 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.153479 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.153991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.153658 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.156264 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.156201 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.156796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.156770 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.171745 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.171683 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfwh5\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.173825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.173790 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.319418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.319318 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:19.673281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.669212 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:43:19.767278 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:19.749868 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6c2745_17b7_4498_ae5e_1cad862c25fe.slice/crio-bce5918b5fc9db926e5b38f6bbe5ada3697c2d0b7cdc858e025fdfc4b1b9d9ef WatchSource:0}: Error finding container bce5918b5fc9db926e5b38f6bbe5ada3697c2d0b7cdc858e025fdfc4b1b9d9ef: Status 404 returned error can't find the container with id bce5918b5fc9db926e5b38f6bbe5ada3697c2d0b7cdc858e025fdfc4b1b9d9ef Oct 31 07:43:19.797464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.788380 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:19.797464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.788482 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:19.797464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.788554 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:19.863275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.862853 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:43:19.941321 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:19.935972 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79934771_5310_4f0d_b953_da23643fa0a6.slice/crio-95ae7deeaf3e1cfdc46a4ad92ba8d1e56a49b3886e63acfa8d098af3728db1af WatchSource:0}: Error finding container 95ae7deeaf3e1cfdc46a4ad92ba8d1e56a49b3886e63acfa8d098af3728db1af: Status 404 returned error can't find the container with id 95ae7deeaf3e1cfdc46a4ad92ba8d1e56a49b3886e63acfa8d098af3728db1af Oct 31 07:43:19.979276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.955697 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:19.979276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.955868 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:19.979276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:19.955935 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:43:20.680273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:20.679323 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" event={"ID":"79934771-5310-4f0d-b953-da23643fa0a6","Type":"ContainerStarted","Data":"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03"} Oct 31 07:43:20.680273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:20.679388 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" event={"ID":"79934771-5310-4f0d-b953-da23643fa0a6","Type":"ContainerStarted","Data":"95ae7deeaf3e1cfdc46a4ad92ba8d1e56a49b3886e63acfa8d098af3728db1af"} Oct 31 07:43:20.777295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:20.773296 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" event={"ID":"ed6c2745-17b7-4498-ae5e-1cad862c25fe","Type":"ContainerStarted","Data":"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc"} Oct 31 07:43:20.777295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:20.773382 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" event={"ID":"ed6c2745-17b7-4498-ae5e-1cad862c25fe","Type":"ContainerStarted","Data":"bce5918b5fc9db926e5b38f6bbe5ada3697c2d0b7cdc858e025fdfc4b1b9d9ef"} Oct 31 07:43:20.777295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:20.776872 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podStartSLOduration=2.7768527560000003 podStartE2EDuration="2.776852756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:20.740752733 +0000 UTC m=+907.387752050" watchObservedRunningTime="2026-10-31 07:43:20.776852756 +0000 UTC m=+907.423852037" Oct 31 07:43:21.131518 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.131411 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:21.133752 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.133708 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:21.147612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.133947 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:21.321547 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.321452 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:21.328731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.328380 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:21.328731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.328437 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:21.616207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.616162 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:21.657938 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:21.657888 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:22.119273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:22.118499 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:22.119273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:22.118662 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:22.320640 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:22.320602 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:22.320906 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:22.320878 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:23.133848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:23.133811 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:23.134468 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:23.134434 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:23.331275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:23.330660 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:23.331275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:23.330722 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:24.158273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:24.157488 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:24.158273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:24.157562 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:24.333292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:24.322712 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:24.333292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:24.322770 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:25.116713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:25.116678 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:25.117020 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:25.116989 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:25.321589 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:25.321556 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:25.322207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:25.322163 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:26.119701 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.119659 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:26.120008 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.119973 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:26.322682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.322642 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:26.323307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.323275 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:26.449594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.449466 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podStartSLOduration=8.449446727 podStartE2EDuration="8.449446727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:20.844407429 +0000 UTC m=+907.491406725" watchObservedRunningTime="2026-10-31 07:43:26.449446727 +0000 UTC m=+913.096446009" Oct 31 07:43:26.469333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.467802 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:43:26.475692 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.475666 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.486960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.486927 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:43:26.488682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.488565 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"openshift-service-ca.crt\"" Oct 31 07:43:26.488682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.488628 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"kube-root-ca.crt\"" Oct 31 07:43:26.493536 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.493421 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"default-dockercfg-hlg77\"" Oct 31 07:43:26.493536 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.493508 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"distinct-w2-b4e8fd-kserve-self-signed-certs\"" Oct 31 07:43:26.594301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594231 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.594496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594310 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.594496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594339 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jlr\" (UniqueName: \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.594622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594547 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.594622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594610 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.594622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.594644 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731498 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731600 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731625 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731717 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731751 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.732332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.731774 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jlr\" (UniqueName: \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.740316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.732819 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.797277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.778776 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.851289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.822612 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jlr\" (UniqueName: \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.851289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.841602 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.877573 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.877536 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:26.898421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:26.897948 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\") pod \"distinct-w2-b4e8fd-kserve-8b5794858-8c48t\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:27.099672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.099636 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:27.145478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.145442 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:27.145564 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.145504 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:27.338686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.328778 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:27.338686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.328835 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:27.571080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.571049 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:43:27.573964 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:27.573931 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8774b283_bb04_4886_bf3d_9562afca3d91.slice/crio-569d67f6be16c5fa9318d9d584f0b94c007166ab2afe609f28f3566995040463 WatchSource:0}: Error finding container 569d67f6be16c5fa9318d9d584f0b94c007166ab2afe609f28f3566995040463: Status 404 returned error can't find the container with id 569d67f6be16c5fa9318d9d584f0b94c007166ab2afe609f28f3566995040463 Oct 31 07:43:27.935550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.935507 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" event={"ID":"8774b283-bb04-4886-bf3d-9562afca3d91","Type":"ContainerStarted","Data":"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f"} Oct 31 07:43:27.935824 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.935805 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" event={"ID":"8774b283-bb04-4886-bf3d-9562afca3d91","Type":"ContainerStarted","Data":"569d67f6be16c5fa9318d9d584f0b94c007166ab2afe609f28f3566995040463"} Oct 31 07:43:27.976786 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:27.976721 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podStartSLOduration=1.976701602 podStartE2EDuration="1.976701602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:27.972084288 +0000 UTC m=+914.619083569" watchObservedRunningTime="2026-10-31 07:43:27.976701602 +0000 UTC m=+914.623700886" Oct 31 07:43:28.105466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:28.105402 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:28.140432 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:28.140389 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 31 07:43:28.140707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:28.140668 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 31 07:43:28.320750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:28.320655 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Oct 31 07:43:28.321003 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:28.320971 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Oct 31 07:43:29.214764 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.214733 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:29.215728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.215705 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:29.216596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.216574 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:43:29.326672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.326642 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:29.327362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.327343 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:29.328598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:29.328574 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:43:37.100274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:37.100224 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:37.113288 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:37.113239 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:38.041920 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:38.041884 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:39.991919 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:43:39.991882 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:43:47.574302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:47.566459 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:47.610279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:47.608801 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:47.697035 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:47.696368 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:47.710192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:47.709377 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:47.841893 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:47.841847 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.036423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.036376 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.111459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.111345 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.624273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.610325 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.644282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.637122 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:43:48.698426 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.698348 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.734275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.730081 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:43:48.734275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.730949 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:43:48.749288 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.736496 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:43:48.863135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.863093 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:43:48.871479 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:48.871452 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:43:49.397756 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.397721 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:43:49.448766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.448721 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:43:49.460413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.459346 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:49.867898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.867861 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:43:49.873207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.867924 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:43:49.873207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.867955 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:43:49.873207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:49.867988 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:43:58.694330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.694211 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:43:58.708192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.708166 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.712185 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.712154 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:43:58.733799 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.733780 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"distinct-2-w1-4794f5-kserve-self-signed-certs\"" Oct 31 07:43:58.771715 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.771682 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.771891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.771724 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.771891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.771812 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.771891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.771841 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.772059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.771974 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmn97\" (UniqueName: \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.772059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.772028 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.873242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.873173 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.900362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.900328 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.900609 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.900591 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.900748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.900732 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.900982 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.900965 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmn97\" (UniqueName: \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.901143 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.901125 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.901637 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.901614 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.901779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.899544 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.904937 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.904909 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.905344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.905323 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.930312 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.926238 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmn97\" (UniqueName: \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:58.937420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:58.931108 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\") pod \"distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:59.045331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:59.040080 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:43:59.368356 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:43:59.368324 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad7ffb31_b09f_4833_b4a3_1ca70838af37.slice/crio-10cfb55bde218232eced0770a30b1c8c86cea810c362eeb12277d9dd9acf42b1 WatchSource:0}: Error finding container 10cfb55bde218232eced0770a30b1c8c86cea810c362eeb12277d9dd9acf42b1: Status 404 returned error can't find the container with id 10cfb55bde218232eced0770a30b1c8c86cea810c362eeb12277d9dd9acf42b1 Oct 31 07:43:59.368504 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:59.368426 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:43:59.704179 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:59.701038 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" event={"ID":"ad7ffb31-b09f-4833-b4a3-1ca70838af37","Type":"ContainerStarted","Data":"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2"} Oct 31 07:43:59.704179 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:59.701094 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" event={"ID":"ad7ffb31-b09f-4833-b4a3-1ca70838af37","Type":"ContainerStarted","Data":"10cfb55bde218232eced0770a30b1c8c86cea810c362eeb12277d9dd9acf42b1"} Oct 31 07:43:59.741788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:43:59.741730 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podStartSLOduration=1.741715243 podStartE2EDuration="1.741715243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:59.738758558 +0000 UTC m=+946.385757862" watchObservedRunningTime="2026-10-31 07:43:59.741715243 +0000 UTC m=+946.388714561" Oct 31 07:44:00.043946 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:00.043853 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:03.843820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.843772 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:44:03.847949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.847923 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.871074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.871040 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:44:03.888875 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.888847 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.888887 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.888907 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889042 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5cn\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889089 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889154 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889320 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889356 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.889608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.889411 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.984340 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.984310 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:44:03.988390 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.988367 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:03.991073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991047 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991095 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991133 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991167 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991198 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991242 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991227 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991348 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5cn\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991426 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991481 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991490 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991617 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991650 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991679 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.991923 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.991897 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.993746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.993694 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:03.994037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:03.994019 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:04.012005 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.011042 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:04.017906 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.017827 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:44:04.024310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.024286 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5cn\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:04.075765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.074002 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:04.077928 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.077906 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092299 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092344 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.092453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092440 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.092598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092576 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bct75\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092649 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092632 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092734 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092718 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092749 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.092836 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092824 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.092870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092847 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.092910 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092875 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.092910 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.092889 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zncnm\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.093017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093000 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.093072 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093053 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.093129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093112 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.093184 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093152 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.093311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093297 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.093376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093324 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.093376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.093357 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.095873 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.095822 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:04.101763 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.101739 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:04.125159 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.119666 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.134610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.134576 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:04.162706 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.162676 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:04.194474 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194448 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.194602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194479 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zncnm\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.194602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194504 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.194602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194529 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.194779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194644 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.194779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194681 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.194779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194721 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.194941 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194768 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.194941 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194827 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.194941 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.194928 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.195091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195036 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.195091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195069 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.195210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195105 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.195210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195144 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.195210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195176 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrs9\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.195403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195216 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.195403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195221 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.195403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195228 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.195403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195293 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.195403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195320 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195527 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195564 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195598 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195617 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195622 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195902 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195895 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bct75\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.195979 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196008 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196082 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196125 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196213 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196246 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196561 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196789 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.196986 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.197643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.197079 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.198587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.198314 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.198587 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.198474 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.200421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.200392 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.200518 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.200449 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.214432 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.214393 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bct75\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.220302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.216132 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zncnm\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.220898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.220871 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.222513 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.222487 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.297823 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.297865 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.297901 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.297974 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298015 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrs9\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298053 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298088 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298178 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298286 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.298871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.298643 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.299602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.299164 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.299602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.299207 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.299602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.299492 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.299771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.299726 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.301672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.301637 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.302070 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.302031 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.316330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.316283 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.318144 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.318124 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrs9\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.353540 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.353469 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:04.392448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.392418 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:04.450140 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.449903 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:04.506710 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.506647 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:44:04.532527 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:04.532471 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36e2b6a_293d_441c_a4b0_11cebaf0ccf0.slice/crio-34e95b277dfedde1653a5a3d2b8d0c9b09bd6c27c6ae9450be728a07157ce4d7 WatchSource:0}: Error finding container 34e95b277dfedde1653a5a3d2b8d0c9b09bd6c27c6ae9450be728a07157ce4d7: Status 404 returned error can't find the container with id 34e95b277dfedde1653a5a3d2b8d0c9b09bd6c27c6ae9450be728a07157ce4d7 Oct 31 07:44:04.543898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.543851 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.544020 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.543964 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.544086 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.544020 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.705459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.705425 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:44:04.741702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.741672 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" event={"ID":"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0","Type":"ContainerStarted","Data":"34e95b277dfedde1653a5a3d2b8d0c9b09bd6c27c6ae9450be728a07157ce4d7"} Oct 31 07:44:04.743573 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:04.743537 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e4deff_f3d9_4a62_b21e_39420747cb23.slice/crio-d180a9cc211fda07286aade9aeb687691ad415c753aca1e4259d2e547e2ee921 WatchSource:0}: Error finding container d180a9cc211fda07286aade9aeb687691ad415c753aca1e4259d2e547e2ee921: Status 404 returned error can't find the container with id d180a9cc211fda07286aade9aeb687691ad415c753aca1e4259d2e547e2ee921 Oct 31 07:44:04.746682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.746634 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.746797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.746726 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.746797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.746774 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.938068 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.937990 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:04.945091 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:04.944028 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd754be66_5b9c_4e39_80b1_4f4fa59a5e3a.slice/crio-09792af9f6be0840fe335ed9503e17154bf9ba8f79252f0e869d76b5aa82c00b WatchSource:0}: Error finding container 09792af9f6be0840fe335ed9503e17154bf9ba8f79252f0e869d76b5aa82c00b: Status 404 returned error can't find the container with id 09792af9f6be0840fe335ed9503e17154bf9ba8f79252f0e869d76b5aa82c00b Oct 31 07:44:04.947418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.947384 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.947569 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.947548 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.947674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.947660 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.986210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.986180 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:04.989581 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:04.989554 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82209f94_5d4a_44f3_b89c_26cfe5963dfc.slice/crio-1c4465f4d2bf5426bc6fd3686ffd740a3bb137dde34cd66a348544fa62fd38e8 WatchSource:0}: Error finding container 1c4465f4d2bf5426bc6fd3686ffd740a3bb137dde34cd66a348544fa62fd38e8: Status 404 returned error can't find the container with id 1c4465f4d2bf5426bc6fd3686ffd740a3bb137dde34cd66a348544fa62fd38e8 Oct 31 07:44:04.992886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.992843 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.992985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.992932 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:04.992985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:04.992977 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:05.768850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.768805 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" event={"ID":"82209f94-5d4a-44f3-b89c-26cfe5963dfc","Type":"ContainerStarted","Data":"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46"} Oct 31 07:44:05.769033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.768874 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" event={"ID":"82209f94-5d4a-44f3-b89c-26cfe5963dfc","Type":"ContainerStarted","Data":"1c4465f4d2bf5426bc6fd3686ffd740a3bb137dde34cd66a348544fa62fd38e8"} Oct 31 07:44:05.770999 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.770968 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" event={"ID":"d3e4deff-f3d9-4a62-b21e-39420747cb23","Type":"ContainerStarted","Data":"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c"} Oct 31 07:44:05.771331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.771273 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" event={"ID":"d3e4deff-f3d9-4a62-b21e-39420747cb23","Type":"ContainerStarted","Data":"d180a9cc211fda07286aade9aeb687691ad415c753aca1e4259d2e547e2ee921"} Oct 31 07:44:05.772937 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.772914 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" event={"ID":"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0","Type":"ContainerStarted","Data":"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06"} Oct 31 07:44:05.774650 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.774629 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" event={"ID":"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a","Type":"ContainerStarted","Data":"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab"} Oct 31 07:44:05.774719 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.774667 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" event={"ID":"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a","Type":"ContainerStarted","Data":"09792af9f6be0840fe335ed9503e17154bf9ba8f79252f0e869d76b5aa82c00b"} Oct 31 07:44:05.811809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.811733 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podStartSLOduration=1.811711624 podStartE2EDuration="1.811711624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.808698612 +0000 UTC m=+952.455697894" watchObservedRunningTime="2026-10-31 07:44:05.811711624 +0000 UTC m=+952.458710905" Oct 31 07:44:05.915273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.908051 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podStartSLOduration=2.908029389 podStartE2EDuration="2.908029389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.871713067 +0000 UTC m=+952.518712349" watchObservedRunningTime="2026-10-31 07:44:05.908029389 +0000 UTC m=+952.555028670" Oct 31 07:44:05.951146 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:05.951086 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podStartSLOduration=1.951070222 podStartE2EDuration="1.951070222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.949285142 +0000 UTC m=+952.596284413" watchObservedRunningTime="2026-10-31 07:44:05.951070222 +0000 UTC m=+952.598069503" Oct 31 07:44:06.167693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.167654 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:06.170357 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.170318 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:06.170623 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.170591 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:06.360273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.359662 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:06.364406 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.364374 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:06.364640 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.364613 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:06.432338 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.431789 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:06.451481 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.451441 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:06.451759 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.451731 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:06.454822 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.454795 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:06.477273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.462446 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:06.477273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:06.462520 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:07.178316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.171680 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:07.178316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.171746 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:07.364375 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.355615 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:07.364375 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.355687 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:07.439335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.437928 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:07.439335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.438017 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:07.483505 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.478375 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:07.485942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.485908 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:07.500233 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.500192 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:07.547410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.547357 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:07.704425 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.669336 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:07.704425 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.669769 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:07.704425 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:07.681324 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:08.116410 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.116362 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": context deadline exceeded" Oct 31 07:44:08.165597 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.165564 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:08.169632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.169585 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:08.372333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.359635 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:08.372333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.359699 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:08.418276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.415701 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:08.418276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.415786 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:08.456274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.455923 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:08.456274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.455997 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:08.481276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.480330 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:08.481276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.480741 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:08.539276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.539181 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podStartSLOduration=5.539160255 podStartE2EDuration="5.539160255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:06.022118771 +0000 UTC m=+952.669118054" watchObservedRunningTime="2026-10-31 07:44:08.539160255 +0000 UTC m=+955.186159537" Oct 31 07:44:08.811331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.810830 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:08.811699 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.811514 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:08.842636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.818801 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:08.842636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.819163 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:08.842636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.820490 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:08.842636 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.820563 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:08.923274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.922325 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:08.996239 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:08.994924 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:09.064546 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.063403 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:09.174920 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.174884 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:09.175188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.175158 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:09.532270 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.532091 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded" Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.557822 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.558144 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.561491 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.561530 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.561868 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:09.639273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.561897 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:09.819065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:09.818969 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:10.000346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.000307 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:44:10.026276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.001407 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:10.088952 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.061221 4406 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": context deadline exceeded" Oct 31 07:44:10.171828 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.171792 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:10.172102 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.172076 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:10.183766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.183724 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:44:10.391508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.391415 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:10.391765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.391734 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:10.453275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.442061 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:10.453275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.442127 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:10.454932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.454899 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:10.455159 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.455134 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:10.514339 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.514307 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:44:10.538109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.536486 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:10.538109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.536878 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:10.598948 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:10.598711 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:44:10.823465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.823356 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:10.834386 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:10.834340 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:11.037526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.037474 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:11.038562 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.038539 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:11.185721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.185685 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:11.186002 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.185972 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:11.358385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.358346 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:11.421689 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.421636 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:11.422397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.368635 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:11.422638 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.422624 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:11.430290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.395947 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:11.430290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.427424 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:11.458354 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.452529 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:11.458354 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.452583 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:11.542947 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.542649 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded" Oct 31 07:44:11.838822 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.838778 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:11.896512 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:11.896482 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:12.193190 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.193060 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:12.193190 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.193136 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:12.393708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.393666 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:12.393971 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.393942 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:12.426361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.396676 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:12.426361 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.397063 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:12.457971 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.457883 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:12.469520 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.469440 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:12.514057 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.514006 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:12.578717 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.578670 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:12.851277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.849344 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:12.878273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:12.874860 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:13.299931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.256641 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:13.304093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.304024 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:13.304337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.304310 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:13.406285 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.385455 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:13.409543 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.409504 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:13.417398 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.400746 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:13.417889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.401322 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:13.418094 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.418069 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:13.644503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.644454 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:13.646510 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.646476 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded" Oct 31 07:44:13.767276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.765388 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:13.767276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.765449 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:13.850290 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.848722 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:44:13.878271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.875433 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:13.878271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:13.878124 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:14.337293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.336528 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:14.337293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.336608 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:14.382280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.374541 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:14.382280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.374610 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:14.478274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.460785 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:14.478274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.460863 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:14.558279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.553832 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:14.583274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.571776 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:14.666325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.665815 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:14.786776 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.786730 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:14.787068 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.787025 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:14.847429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.847367 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 31 07:44:14.909453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:14.909392 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:15.037330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.011342 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:15.418719 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.418688 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:15.418985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.418958 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:15.501345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.497514 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:15.798335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.794185 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:15.798898 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.667077 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:15.810284 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.573172 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:15.811581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.572825 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:15.811764 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.811733 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:15.811897 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.775470 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:15.818349 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.818311 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:15.893229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.866227 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 31 07:44:15.894337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.894310 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:15.919428 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:15.919379 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:16.037274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.034157 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded" Oct 31 07:44:16.100846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.100810 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:16.101112 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.101084 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:16.182687 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.182653 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:16.183351 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.183319 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:16.365997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.365678 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:16.365997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.365743 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:16.393407 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.393369 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:16.393675 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.393645 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:16.541618 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.541582 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:16.541906 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.541875 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:16.581877 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.581237 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:44:16.673445 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.673332 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:16.770567 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.770537 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:16.838027 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.815481 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:16.919408 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.919361 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:16.951329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:16.922475 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:17.074275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.037376 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:17.205329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.179820 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:17.205616 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.205578 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:17.397871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.396115 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:17.397871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.396178 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:17.397871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.396842 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:17.397871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.396882 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:17.650452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.650411 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:17.717097 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.717045 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:17.810318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.781166 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded" Oct 31 07:44:17.875343 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.873106 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:17.927064 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:17.926968 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 31 07:44:18.019392 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.019343 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:18.041274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.038059 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:18.104623 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.104580 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:18.259300 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.259188 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:18.308328 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.259514 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:18.381681 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.381645 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:18.381957 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.381926 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:18.747276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.645989 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:18.747276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.646052 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:18.747276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.646978 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:18.747276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.647019 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:18.783546 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.783499 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:18.812382 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.787961 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:18.937279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.927034 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:18.948790 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:18.927508 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:19.022681 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.022590 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:19.054470 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.054421 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:19.168184 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.168143 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:19.231275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.198381 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:19.231629 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.231587 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:19.366275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.358363 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:19.483449 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.483417 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:19.519279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.501385 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:19.680746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.680640 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:19.681023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.680991 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:19.690295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.689425 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:19.690295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.689497 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:19.764297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.764234 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:19.786567 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.784718 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:19.839714 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:19.839666 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:20.032734 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.032621 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:20.033362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.033323 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:20.058684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.057294 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:20.079274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.070325 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:20.079274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.070579 4406 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": context deadline exceeded" Oct 31 07:44:20.251269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.248790 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 31 07:44:20.251269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.248875 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 31 07:44:20.356835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.355279 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 31 07:44:20.356835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.355339 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 31 07:44:20.396133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.396097 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:20.396419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.396388 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:20.451582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.451530 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:20.451858 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.451828 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:20.843330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:20.842395 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:21.008497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.007044 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:21.055030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.054419 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:21.066477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.065755 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:21.092899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.092208 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:21.161448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.159337 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:21.164345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.164320 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:44:21.401280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.400345 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 31 07:44:21.401280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.400405 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 31 07:44:21.474333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.452941 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 31 07:44:21.474333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.453003 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 31 07:44:21.598079 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.584406 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" containerID="cri-o://767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a" gracePeriod=25 Oct 31 07:44:21.660304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.653624 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:21.870279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.855534 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded" Oct 31 07:44:21.968915 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:21.968863 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:22.166222 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:22.166105 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:22.166899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:22.166863 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:22.369402 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:22.369355 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:22.369604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:22.369434 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:23.147275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.144762 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:23.154283 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.153822 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:23.213398 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.213343 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:23.214040 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.213987 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:23.422693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.422598 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:23.422981 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.422933 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:23.480603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.464918 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:23.480603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.465000 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:23.933832 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.928235 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:23.982878 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:23.982607 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:44:24.207009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:24.206913 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:24.215094 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:24.215057 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:44:24.543384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:24.543282 4406 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:24.564145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:24.563335 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:25.118979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.116031 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:25.118979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.117734 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:25.236278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.235018 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 31 07:44:25.460035 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.459937 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" containerID="cri-o://727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26" gracePeriod=45 Oct 31 07:44:25.537764 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.537708 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" containerID="cri-o://68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db" gracePeriod=45 Oct 31 07:44:25.537974 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.537947 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": dial tcp 10.133.0.52:8000: connect: connection refused" Oct 31 07:44:25.778925 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.778878 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" containerID="cri-o://ba8b73a449f294b4d039bc4fa79dcd4fbcce80dfe8ef9a368586270551859cc8" gracePeriod=45 Oct 31 07:44:25.907951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.907926 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:25.916509 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:25.912562 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.020785 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\" (UniqueName: \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.020894 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\" (UniqueName: \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.020939 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.020989 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021054 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021084 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021236 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\" (UniqueName: \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021296 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021327 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021431 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021485 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\") pod \"8901f4dc-b37c-4996-8847-75b2d5a0367e\" (UID: \"8901f4dc-b37c-4996-8847-75b2d5a0367e\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.021540 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\" (UniqueName: \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\") pod \"92673a3d-d247-4c5a-8f17-92dd469d9a61\" (UID: \"92673a3d-d247-4c5a-8f17-92dd469d9a61\") " Oct 31 07:44:26.039604 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.029115 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.056933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.056557 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.057854 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.057818 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.057959 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.057885 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.064131 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.063840 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.064422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.064371 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.082326 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.080888 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "kube-api-access-xnsj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:26.096513 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.096038 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.108891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.108458 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "kube-api-access-6n5w5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:26.117789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.111639 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124490 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124525 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124538 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124549 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124564 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnsj5\" (UniqueName: \"kubernetes.io/projected/8901f4dc-b37c-4996-8847-75b2d5a0367e-kube-api-access-xnsj5\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124577 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124591 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124604 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92673a3d-d247-4c5a-8f17-92dd469d9a61-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124616 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8901f4dc-b37c-4996-8847-75b2d5a0367e-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.124754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.124629 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n5w5\" (UniqueName: \"kubernetes.io/projected/92673a3d-d247-4c5a-8f17-92dd469d9a61-kube-api-access-6n5w5\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.128823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.126340 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs" pod "92673a3d-d247-4c5a-8f17-92dd469d9a61" (UID: "92673a3d-d247-4c5a-8f17-92dd469d9a61"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:44:26.129524 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.129290 4406 generic.go:356] "Generic (PLEG): container finished" podID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerID="ba8b73a449f294b4d039bc4fa79dcd4fbcce80dfe8ef9a368586270551859cc8" exitCode=0 Oct 31 07:44:26.129524 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.129451 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" event={"ID":"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4","Type":"ContainerDied","Data":"ba8b73a449f294b4d039bc4fa79dcd4fbcce80dfe8ef9a368586270551859cc8"} Oct 31 07:44:26.132328 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.131936 4406 generic.go:356] "Generic (PLEG): container finished" podID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerID="68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db" exitCode=0 Oct 31 07:44:26.132328 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.132046 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" Oct 31 07:44:26.132934 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.132671 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" event={"ID":"92673a3d-d247-4c5a-8f17-92dd469d9a61","Type":"ContainerDied","Data":"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db"} Oct 31 07:44:26.132934 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.132721 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" event={"ID":"92673a3d-d247-4c5a-8f17-92dd469d9a61","Type":"ContainerDied","Data":"b447e285134e442a2853ffe3466a08bc37b0d25b94a37ace72494bc6fe968d36"} Oct 31 07:44:26.132934 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.132747 4406 scope.go:122] "RemoveContainer" containerID="68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db" Oct 31 07:44:26.149926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.148991 4406 generic.go:356] "Generic (PLEG): container finished" podID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerID="727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26" exitCode=0 Oct 31 07:44:26.149926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.149399 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" Oct 31 07:44:26.149926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.149805 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" event={"ID":"8901f4dc-b37c-4996-8847-75b2d5a0367e","Type":"ContainerDied","Data":"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26"} Oct 31 07:44:26.149926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.149840 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd" event={"ID":"8901f4dc-b37c-4996-8847-75b2d5a0367e","Type":"ContainerDied","Data":"fd83595efd73a0a846623d61af58f4092dee74dea04c60e001e350343f4dcd89"} Oct 31 07:44:26.162759 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.162582 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs" pod "8901f4dc-b37c-4996-8847-75b2d5a0367e" (UID: "8901f4dc-b37c-4996-8847-75b2d5a0367e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:44:26.174091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.173662 4406 scope.go:122] "RemoveContainer" containerID="68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db" Oct 31 07:44:26.176208 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:26.176044 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db\": container with ID starting with 68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db not found: ID does not exist" containerID="68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db" Oct 31 07:44:26.176208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.176088 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db"} err="failed to get container status \"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db\": rpc error: code = NotFound desc = could not find container \"68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db\": container with ID starting with 68f8b6852cbf79f9fcdc128ea396397570c73f64c47cc662f8d0d78bd242c0db not found: ID does not exist" Oct 31 07:44:26.176208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.176109 4406 scope.go:122] "RemoveContainer" containerID="727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26" Oct 31 07:44:26.188308 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.188293 4406 scope.go:122] "RemoveContainer" containerID="727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26" Oct 31 07:44:26.188724 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:26.188707 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26\": container with ID starting with 727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26 not found: ID does not exist" containerID="727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26" Oct 31 07:44:26.188834 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.188818 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26"} err="failed to get container status \"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26\": rpc error: code = NotFound desc = could not find container \"727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26\": container with ID starting with 727845cc27591586d16c2377c60ae11dd203873eeebbb34f8d10b23dd989ea26 not found: ID does not exist" Oct 31 07:44:26.200162 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.200132 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:44:26.210288 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.210260 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r"] Oct 31 07:44:26.229997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.229403 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92673a3d-d247-4c5a-8f17-92dd469d9a61-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.229997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.229434 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8901f4dc-b37c-4996-8847-75b2d5a0367e-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.253618 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.253587 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:44:26.330168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330129 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\" (UniqueName: \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.330371 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330190 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.330371 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330332 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.330496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330373 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.330567 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330548 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.330642 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.330627 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\") pod \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\" (UID: \"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4\") " Oct 31 07:44:26.332341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.332313 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.332473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.332322 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.332473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.332364 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.334725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.334696 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:44:26.336519 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.336490 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "kube-api-access-j4nzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:26.338116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.338085 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm" pod "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" (UID: "b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:26.432931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432894 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.432931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432921 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.432931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432931 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4nzt\" (UniqueName: \"kubernetes.io/projected/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-kube-api-access-j4nzt\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.432931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432940 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.433291 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432948 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.433291 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.432955 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:26.500241 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.500208 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:44:26.502817 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.502785 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/distinct-w0-648fbe-kserve-6d4c59bf7b-49lgd"] Oct 31 07:44:26.822913 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:26.822819 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-648fbe/premium-w0-648fbe-kserve-dcf7b474f-28g2r" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 31 07:44:27.160186 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.160155 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" event={"ID":"b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4","Type":"ContainerDied","Data":"04107f56832aab68b4c8c57ac84c3188f47a535752e06ae2a78d07440533a771"} Oct 31 07:44:27.160414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.160203 4406 scope.go:122] "RemoveContainer" containerID="ba8b73a449f294b4d039bc4fa79dcd4fbcce80dfe8ef9a368586270551859cc8" Oct 31 07:44:27.160414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.160212 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf" Oct 31 07:44:27.222118 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.221933 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:44:27.231555 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.231525 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-648fbe/simulator-w0-648fbe-kserve-55d7cc55cb-tkxqf"] Oct 31 07:44:27.481382 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.481301 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" path="/var/lib/kubelet/pods/8901f4dc-b37c-4996-8847-75b2d5a0367e/volumes" Oct 31 07:44:27.481802 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.481787 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" path="/var/lib/kubelet/pods/92673a3d-d247-4c5a-8f17-92dd469d9a61/volumes" Oct 31 07:44:27.482191 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:27.482179 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" path="/var/lib/kubelet/pods/b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4/volumes" Oct 31 07:44:29.056537 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:29.056504 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:29.068002 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:29.067972 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:33.590275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.584209 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607865 4406 cpu_manager.go:414] "containerMap: removing container" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607892 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607956 4406 cpu_manager.go:414] "containerMap: removing container" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607964 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607979 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.607986 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.608111 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4ec4c4c-6e04-4a78-80a2-fabb6e9a72b4" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.608129 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="92673a3d-d247-4c5a-8f17-92dd469d9a61" containerName="main" Oct 31 07:44:33.608695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.608140 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8901f4dc-b37c-4996-8847-75b2d5a0367e" containerName="main" Oct 31 07:44:33.701643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.701605 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:44:33.722017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.715405 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.773798 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.773846 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.773879 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.773908 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.774036 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9rb\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.774122 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.774187 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.774232 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.781331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.774298 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.808273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.808039 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:44:33.808273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.808089 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:44:33.808273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.808117 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:44:33.812738 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.811478 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.824615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.824570 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.824768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.824728 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875371 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875426 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875534 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875557 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875578 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875627 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875683 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875704 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.875707 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875726 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875794 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875813 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875828 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875877 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcdmz\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875903 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875946 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9rb\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875966 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.875988 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876012 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plp9f\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876029 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876064 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876100 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876159 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876215 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876244 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.876486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876305 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.877433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876752 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.877433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.876962 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.878833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.878266 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.878833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.878591 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.878833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.878613 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.880455 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.877299 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.881236 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.881140 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.881815 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.881789 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.882856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.882736 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.898609 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.898583 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.898798 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.898619 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9rb\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:33.982742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982710 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.982942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982751 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.982942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982818 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.982942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982846 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcdmz\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.982942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982888 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982951 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.982983 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983020 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plp9f\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983157 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983165 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983223 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983583 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983239 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983583 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983376 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983583 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983520 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983583 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983557 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983633 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983691 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983752 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.983847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983808 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.983847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983837 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983861 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.983912 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984000 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984012 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984357 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984237 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.984357 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984321 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.984464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984385 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.984592 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.984574 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.986328 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.986307 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.986448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.986418 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:33.986542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.986520 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:33.986909 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:33.986892 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:34.001195 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.001150 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plp9f\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:34.001651 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.001630 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcdmz\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:34.001760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.001741 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:34.001823 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.001775 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:34.138788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.138698 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:34.141596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.141572 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:34.158341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.158315 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:34.326585 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.323713 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:44:34.334579 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.334323 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.366503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.366478 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:44:34.382318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.379657 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:44:34.384654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.384626 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.416115 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.405912 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:44:34.462063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462032 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462118 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462135 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462153 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462173 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462442 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462211 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462442 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462285 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462442 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462341 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.462442 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.462362 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nd2\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.550722 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.550695 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:44:34.553179 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:34.553152 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0269e9c8_9c88_4bc9_a581_577653c3984e.slice/crio-67b68ac91340df1afb28b9ff9c20748cc7bcce6127ce6734e3acffc0c8fb5650 WatchSource:0}: Error finding container 67b68ac91340df1afb28b9ff9c20748cc7bcce6127ce6734e3acffc0c8fb5650: Status 404 returned error can't find the container with id 67b68ac91340df1afb28b9ff9c20748cc7bcce6127ce6734e3acffc0c8fb5650 Oct 31 07:44:34.558359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.558316 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.558533 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.558406 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.558533 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.558447 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.564065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564030 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564082 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564116 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564147 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564204 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564230 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564286 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564415 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564351 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564408 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564475 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mfm\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564528 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564505 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564563 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564538 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564575 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nd2\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564700 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564775 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.564835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564801 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564854 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.564961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.564933 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.565386 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.565362 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.566074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.566050 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.566654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.566633 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.566748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.566720 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.566886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.566863 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.570327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.570299 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.571021 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.570996 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.585077 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.585043 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nd2\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.590577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.590554 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.656848 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.656820 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:44:34.658495 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:34.658466 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3037fe6_8663_4e40_a96a_b3f2ceadfafc.slice/crio-7e8a148aa9fd89013a500765e48b50dead2aff784085da4c33dd95d27ce44306 WatchSource:0}: Error finding container 7e8a148aa9fd89013a500765e48b50dead2aff784085da4c33dd95d27ce44306: Status 404 returned error can't find the container with id 7e8a148aa9fd89013a500765e48b50dead2aff784085da4c33dd95d27ce44306 Oct 31 07:44:34.662000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.661966 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.662105 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.662051 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.662105 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.662094 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.665903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.665879 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.665948 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.665986 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666119 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666067 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666119 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666106 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mfm\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666138 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666267 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.666350 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666325 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666399 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666498 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.666649 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.667027 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.667411 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.667577 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.667432 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.668925 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.668900 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.669518 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.669502 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.678668 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.678604 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:34.685671 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.685645 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mfm\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.686925 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.686894 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:34.712650 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.712621 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:44:34.718844 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:44:34.718788 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78966f9_8814_4336_ac82_c30f1115b67c.slice/crio-dcd235c73a6734fa3ace0dbc465b427dabb268742b7167fb6895a8d1a099175f WatchSource:0}: Error finding container dcd235c73a6734fa3ace0dbc465b427dabb268742b7167fb6895a8d1a099175f: Status 404 returned error can't find the container with id dcd235c73a6734fa3ace0dbc465b427dabb268742b7167fb6895a8d1a099175f Oct 31 07:44:34.722509 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.722465 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.722677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.722563 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.722677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.722607 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:34.736414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:34.736111 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:35.079645 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.078752 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:44:35.082198 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.081110 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.082198 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.081204 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.082198 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.081263 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.232490 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.232083 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 31 07:44:35.368788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.368757 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:44:35.372052 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.372015 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.372177 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.372082 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.372177 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.372116 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:44:35.385156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.385123 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" event={"ID":"0269e9c8-9c88-4bc9-a581-577653c3984e","Type":"ContainerStarted","Data":"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0"} Oct 31 07:44:35.385346 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.385187 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" event={"ID":"0269e9c8-9c88-4bc9-a581-577653c3984e","Type":"ContainerStarted","Data":"67b68ac91340df1afb28b9ff9c20748cc7bcce6127ce6734e3acffc0c8fb5650"} Oct 31 07:44:35.397811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.396876 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" event={"ID":"f78966f9-8814-4336-ac82-c30f1115b67c","Type":"ContainerStarted","Data":"a7c6f97f15ea72efb2e865d4ae4840973363258d442ba8b14918a7392d93d3f5"} Oct 31 07:44:35.397811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.396930 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" event={"ID":"f78966f9-8814-4336-ac82-c30f1115b67c","Type":"ContainerStarted","Data":"dcd235c73a6734fa3ace0dbc465b427dabb268742b7167fb6895a8d1a099175f"} Oct 31 07:44:35.401766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.401735 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" event={"ID":"a3037fe6-8663-4e40-a96a-b3f2ceadfafc","Type":"ContainerStarted","Data":"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f"} Oct 31 07:44:35.401882 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.401791 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" event={"ID":"a3037fe6-8663-4e40-a96a-b3f2ceadfafc","Type":"ContainerStarted","Data":"7e8a148aa9fd89013a500765e48b50dead2aff784085da4c33dd95d27ce44306"} Oct 31 07:44:35.404306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.404277 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" event={"ID":"2b09831b-6f19-4986-b09d-3d88e2fa185d","Type":"ContainerStarted","Data":"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e"} Oct 31 07:44:35.405696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.404461 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" event={"ID":"2b09831b-6f19-4986-b09d-3d88e2fa185d","Type":"ContainerStarted","Data":"579cd53a7ab5e51f72b6407a5c2709ecad50309278a8a5e7f0ab4d32852df930"} Oct 31 07:44:35.430816 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.425222 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podStartSLOduration=2.425205026 podStartE2EDuration="2.425205026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.423838306 +0000 UTC m=+982.070837588" watchObservedRunningTime="2026-10-31 07:44:35.425205026 +0000 UTC m=+982.072204308" Oct 31 07:44:35.523470 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.523352 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podStartSLOduration=2.523332958 podStartE2EDuration="2.523332958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.46359728 +0000 UTC m=+982.110596562" watchObservedRunningTime="2026-10-31 07:44:35.523332958 +0000 UTC m=+982.170332240" Oct 31 07:44:35.547765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.547694 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podStartSLOduration=1.547673435 podStartE2EDuration="1.547673435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.509312942 +0000 UTC m=+982.156312225" watchObservedRunningTime="2026-10-31 07:44:35.547673435 +0000 UTC m=+982.194672719" Oct 31 07:44:35.570651 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.563886 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podStartSLOduration=2.563866423 podStartE2EDuration="2.563866423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.546908206 +0000 UTC m=+982.193907488" watchObservedRunningTime="2026-10-31 07:44:35.563866423 +0000 UTC m=+982.210865705" Oct 31 07:44:35.682924 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:35.682878 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:36.181933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.140986 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:36.181933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.141893 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:36.181933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.166827 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209493 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209554 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209855 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209884 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209946 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:36.296276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.209966 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:36.665734 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.665697 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" event={"ID":"3a15c77a-477e-40ec-8038-464f5e4d5e60","Type":"ContainerStarted","Data":"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e"} Oct 31 07:44:36.666042 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.666005 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" event={"ID":"3a15c77a-477e-40ec-8038-464f5e4d5e60","Type":"ContainerStarted","Data":"d6ee444e0b45b4eec36549e8c345937616bfd1ffd9ad36ec7655ef1118fd36e0"} Oct 31 07:44:36.686496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.686465 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:36.687034 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.687001 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:36.831288 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.831231 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:36.839464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.839360 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:36.839464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.839440 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:36.949342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:36.946931 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podStartSLOduration=2.946907381 podStartE2EDuration="2.946907381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:36.808394554 +0000 UTC m=+983.455393836" watchObservedRunningTime="2026-10-31 07:44:36.946907381 +0000 UTC m=+983.593906664" Oct 31 07:44:37.100277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.083697 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:37.254018 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.239968 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": context deadline exceeded" Oct 31 07:44:37.268283 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.267555 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:37.268283 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.267626 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:37.282874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.269957 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:37.282874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.270018 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:37.282874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.282701 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:37.282874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.282763 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:37.684782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.684744 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:37.685038 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.685009 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:37.759944 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.749883 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:37.759944 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.749947 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:37.853277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:37.849952 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:38.112409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.112362 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:38.129441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.113458 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:38.178730 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.130200 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:38.204737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.141933 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:38.205018 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.204987 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:38.205142 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.142159 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:38.205278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.205240 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:38.205419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.177666 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:38.205530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.205514 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:38.294300 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.269702 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:38.294300 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.271189 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:38.727278 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.715603 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:38.786400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.786341 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:38.852096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.755220 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:38.870654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.851935 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:38.871182 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.871158 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:38.872511 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:38.870610 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:39.139275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.138362 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:39.153228 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.153111 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:39.153228 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.153168 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:39.164966 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.164846 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:39.164966 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.164901 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:39.271192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.271141 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:39.272390 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.272358 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:39.272590 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.272568 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:39.737497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.737460 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:39.737899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.737865 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:39.741028 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.741000 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:39.741215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.741193 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:39.889274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:39.888819 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:40.054189 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.054089 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:40.141026 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.140967 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:40.155131 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.155010 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:40.155514 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.155390 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:40.156274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.156229 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:40.156451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.156428 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:40.161211 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.161176 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:40.161400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.161377 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:40.235275 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:40.232934 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:44:40.296892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.296833 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:40.695273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.694707 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:40.695273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.694771 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:40.747979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.747946 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:40.758365 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.758323 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:40.951747 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:40.909342 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:41.325347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.150650 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:41.325347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.323448 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:41.325347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.153334 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:41.325347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.325050 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:41.361271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.332947 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:41.361271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.332995 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:41.361271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.354965 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:41.361271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.355012 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:41.752362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.739634 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:41.766274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.763214 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:41.766733 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.766702 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:41.766953 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:41.766926 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:42.099332 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:42.073146 4406 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992f19b3_a06c_4c02_a976_cf5f2f33f61a.slice/crio-conmon-767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a.scope\": RecentStats: unable to find data in memory cache]" Oct 31 07:44:42.165280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.157614 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:42.165280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.157675 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:42.206275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.188406 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:42.206275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.188486 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:42.206275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.189555 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:42.206275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.189614 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:42.324522 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.324461 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:42.345275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.334325 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": context deadline exceeded" Oct 31 07:44:42.374367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.346278 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:42.693907 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.693815 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:42.694149 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.694119 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:42.845716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.845683 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:42.846074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:42.846040 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:43.142756 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.142718 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:43.157418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.157376 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:43.301293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.292603 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:43.301293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.292664 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:43.301293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.292824 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:43.301293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.292870 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:43.347475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.335742 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:43.363318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.347747 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:43.363318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.355309 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": context deadline exceeded" Oct 31 07:44:43.761874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.705374 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:43.761874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.705439 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:43.761874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.761227 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:43.761874 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.761304 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:43.956321 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.944370 4406 generic.go:356] "Generic (PLEG): container finished" podID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerID="767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a" exitCode=0 Oct 31 07:44:43.956321 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:43.944542 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" event={"ID":"992f19b3-a06c-4c02-a976-cf5f2f33f61a","Type":"ContainerDied","Data":"767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a"} Oct 31 07:44:44.133109 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.118505 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:44.179279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.173124 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:44.179279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.173181 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:44.206799 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.206364 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:44.290295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.273552 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:44.290295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.273629 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:44.290295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.273760 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:44.290295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.273784 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:44.436835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.402705 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:44.541285 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.541154 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:44:44.583337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.572706 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\") pod \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " Oct 31 07:44:44.583903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.583869 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\" (UniqueName: \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\") pod \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\" (UID: \"992f19b3-a06c-4c02-a976-cf5f2f33f61a\") " Oct 31 07:44:44.618568 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.618524 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume" pod "992f19b3-a06c-4c02-a976-cf5f2f33f61a" (UID: "992f19b3-a06c-4c02-a976-cf5f2f33f61a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:44:44.740325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.737640 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:44.740325 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.737707 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:44.817274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.791691 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:44.845654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.830586 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf" pod "992f19b3-a06c-4c02-a976-cf5f2f33f61a" (UID: "992f19b3-a06c-4c02-a976-cf5f2f33f61a"). InnerVolumeSpecName "kube-api-access-bndgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:44.845654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.839313 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:44.917819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.917744 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bndgf\" (UniqueName: \"kubernetes.io/projected/992f19b3-a06c-4c02-a976-cf5f2f33f61a-kube-api-access-bndgf\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:44.919090 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:44.919064 4406 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/992f19b3-a06c-4c02-a976-cf5f2f33f61a-plugins-config-volume\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:45.071321 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.054205 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" event={"ID":"992f19b3-a06c-4c02-a976-cf5f2f33f61a","Type":"ContainerDied","Data":"eaf4be90033efbc03577a33278c11b56249c16752ecf3a6013c7cc78ac96f9da"} Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.199363 4406 scope.go:122] "RemoveContainer" containerID="767dc3f7bbe0e7bbf41da350d164f0f806015bbb17fcd52e10eae164d2a21e5a" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.063703 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.119044 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.171635 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.236587 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.235563 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.236639 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.182558 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.236335 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:45.268281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.236816 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:45.408094 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.405409 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:45.439028 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.438300 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:44:45.439028 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.438567 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" containerID="cri-o://b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086" gracePeriod=30 Oct 31 07:44:45.765331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.741620 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:45.765331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.741679 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:45.776564 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.776535 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:44:45.780385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.780331 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" containerID="cri-o://2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03" gracePeriod=30 Oct 31 07:44:45.827206 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.827164 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:45.827505 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.827463 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:45.936652 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.936621 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:45.937489 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.937449 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" containerID="cri-o://a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab" gracePeriod=30 Oct 31 07:44:45.987599 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.981582 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:46.013280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.991677 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:46.013280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:45.991990 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" containerID="cri-o://f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46" gracePeriod=30 Oct 31 07:44:46.169274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.144272 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.212635 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.170194 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.216304 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.170237 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.270196 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.269673 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.270717 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.271853 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:46.310276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.272326 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:46.459326 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.434112 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:44:46.631475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.630113 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-648fbe-5d7f5f5564-jwtmp"] Oct 31 07:44:46.773887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.773785 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:46.774420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.774391 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:46.774643 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.774617 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:46.796515 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.796482 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:46.796769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:46.796741 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:47.151237 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.150728 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:47.151237 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.150792 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:47.176833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.176633 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:47.176833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.176690 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:47.176833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.176769 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:47.176833 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.176791 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:47.275304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.272272 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:47.275304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.273643 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:47.395134 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.395079 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:47.676275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.645557 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" path="/var/lib/kubelet/pods/992f19b3-a06c-4c02-a976-cf5f2f33f61a/volumes" Oct 31 07:44:47.700376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.697735 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:47.700376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.697793 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:47.760662 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.760629 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:47.761160 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:47.761126 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:48.109401 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.109357 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": context deadline exceeded" Oct 31 07:44:48.139973 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.139939 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:48.140240 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.140212 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:48.160284 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.154046 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 31 07:44:48.160527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.160497 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 31 07:44:48.192982 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.192946 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 31 07:44:48.215507 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.215461 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 31 07:44:48.293374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.292361 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:48.293374 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.292792 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:44:48.395344 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.395241 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:48.481527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.481499 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:48.680369 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.680211 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:48.680996 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.680601 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:48.773274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.759391 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:48.773274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:48.759458 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:49.145283 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.145051 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:49.146532 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.145634 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:49.146684 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.144953 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body= Oct 31 07:44:49.146799 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.146660 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" Oct 31 07:44:49.168174 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.168142 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:49.689716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.689682 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body= Oct 31 07:44:49.707558 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.707517 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" Oct 31 07:44:49.708044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.690926 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:49.742522 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.742489 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:49.762276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.761376 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body= Oct 31 07:44:49.762276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:49.761442 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" Oct 31 07:44:50.085276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.082724 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:50.085276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.085111 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:44:50.171367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.161140 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:50.171367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.161212 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:50.201215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.199054 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:50.208568 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.208488 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:44:50.495634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.495547 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:50.514588 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.514559 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:44:50.732002 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.730566 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:50.741467 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:50.741442 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:44:51.022228 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.022198 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:51.025184 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.025012 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:44:51.172499 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.172038 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206378 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206490 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206570 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206604 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206645 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206729 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206840 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206906 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.208053 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.206953 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\") pod \"9df2bdd0-ab56-4443-b8ef-226466813d05\" (UID: \"9df2bdd0-ab56-4443-b8ef-226466813d05\") " Oct 31 07:44:51.210523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.210477 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.210731 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.210699 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.211006 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.210960 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.211199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.211157 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.211484 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.211448 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:44:51.215688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.215652 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.216859 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.216824 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "kube-api-access-lgxds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.218521 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.217962 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.234680 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.233421 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo" pod "9df2bdd0-ab56-4443-b8ef-226466813d05" (UID: "9df2bdd0-ab56-4443-b8ef-226466813d05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:44:51.313273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.282515 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:44:51.412215 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.412174 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.430210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.429476 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.431152 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.431128 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.432400 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.431357 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.432605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.432590 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.433101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.433083 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.433336 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.433293 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.438330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.438305 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.438450 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.438398 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.438495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.438476 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.438541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.438524 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\") pod \"79934771-5310-4f0d-b953-da23643fa0a6\" (UID: \"79934771-5310-4f0d-b953-da23643fa0a6\") " Oct 31 07:44:51.439280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439226 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439274 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439289 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439304 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgxds\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-kube-api-access-lgxds\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439318 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439332 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439345 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439358 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439370 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439383 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df2bdd0-ab56-4443-b8ef-226466813d05-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.439433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439397 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df2bdd0-ab56-4443-b8ef-226466813d05-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.440023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.439943 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:44:51.440023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.440001 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.440916 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.440888 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.445541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.445515 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "kube-api-access-lfwh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.445623 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.445580 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:44:51.446418 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.446394 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.447189 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.447152 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token" pod "79934771-5310-4f0d-b953-da23643fa0a6" (UID: "79934771-5310-4f0d-b953-da23643fa0a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.461071 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.461054 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:51.540774 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.540738 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.540953 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.540851 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541015 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.540936 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541144 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541126 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541207 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.541359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541336 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541432 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541522 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541504 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541590 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541575 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.541690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541672 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.541754 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.541740 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\") pod \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\" (UID: \"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a\") " Oct 31 07:44:51.542105 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.542084 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.542266 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.542231 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:44:51.542359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.542268 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543768 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543793 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543815 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543846 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543860 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79934771-5310-4f0d-b953-da23643fa0a6-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543874 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79934771-5310-4f0d-b953-da23643fa0a6-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543889 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543919 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543933 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79934771-5310-4f0d-b953-da23643fa0a6-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.543949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543949 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfwh5\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-kube-api-access-lfwh5\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.544474 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543965 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.544474 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.543993 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79934771-5310-4f0d-b953-da23643fa0a6-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.548769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.548732 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "kube-api-access-bct75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.548964 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.548939 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.549456 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.549417 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.550566 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.550532 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo" pod "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" (UID: "d754be66-5b9c-4e39-80b1-4f4fa59a5e3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:44:51.580225 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.580201 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:51.624044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.622636 4406 generic.go:356] "Generic (PLEG): container finished" podID="79934771-5310-4f0d-b953-da23643fa0a6" containerID="2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03" exitCode=0 Oct 31 07:44:51.624044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.622794 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" event={"ID":"79934771-5310-4f0d-b953-da23643fa0a6","Type":"ContainerDied","Data":"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03"} Oct 31 07:44:51.624044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.622845 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" event={"ID":"79934771-5310-4f0d-b953-da23643fa0a6","Type":"ContainerDied","Data":"95ae7deeaf3e1cfdc46a4ad92ba8d1e56a49b3886e63acfa8d098af3728db1af"} Oct 31 07:44:51.624044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.622874 4406 scope.go:122] "RemoveContainer" containerID="2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03" Oct 31 07:44:51.624044 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.623023 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9" Oct 31 07:44:51.627950 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.627923 4406 generic.go:356] "Generic (PLEG): container finished" podID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerID="f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46" exitCode=0 Oct 31 07:44:51.628065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.627978 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" Oct 31 07:44:51.628065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.627998 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" event={"ID":"82209f94-5d4a-44f3-b89c-26cfe5963dfc","Type":"ContainerDied","Data":"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46"} Oct 31 07:44:51.628163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.628068 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v" event={"ID":"82209f94-5d4a-44f3-b89c-26cfe5963dfc","Type":"ContainerDied","Data":"1c4465f4d2bf5426bc6fd3686ffd740a3bb137dde34cd66a348544fa62fd38e8"} Oct 31 07:44:51.630230 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.630208 4406 generic.go:356] "Generic (PLEG): container finished" podID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerID="b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086" exitCode=0 Oct 31 07:44:51.630425 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.630394 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerDied","Data":"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086"} Oct 31 07:44:51.630539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.630449 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" event={"ID":"9df2bdd0-ab56-4443-b8ef-226466813d05","Type":"ContainerDied","Data":"1344b7eb70fa9b5294c8f173c4867b7d74807a926493a2d369d8fe045904caeb"} Oct 31 07:44:51.630539 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.630515 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r" Oct 31 07:44:51.632443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.632420 4406 generic.go:356] "Generic (PLEG): container finished" podID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerID="a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab" exitCode=0 Oct 31 07:44:51.633983 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.633964 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" event={"ID":"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a","Type":"ContainerDied","Data":"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab"} Oct 31 07:44:51.634098 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.634011 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" event={"ID":"d754be66-5b9c-4e39-80b1-4f4fa59a5e3a","Type":"ContainerDied","Data":"09792af9f6be0840fe335ed9503e17154bf9ba8f79252f0e869d76b5aa82c00b"} Oct 31 07:44:51.634098 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.634078 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b" Oct 31 07:44:51.641235 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.641203 4406 scope.go:122] "RemoveContainer" containerID="2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03" Oct 31 07:44:51.643960 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:51.643936 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03\": container with ID starting with 2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03 not found: ID does not exist" containerID="2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03" Oct 31 07:44:51.644480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.644446 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03"} err="failed to get container status \"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03\": rpc error: code = NotFound desc = could not find container \"2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03\": container with ID starting with 2b3a5f194ea9315b66cfc8e6f0e6398aa2a482f8c8d8528a4e9055c6dc12ec03 not found: ID does not exist" Oct 31 07:44:51.644670 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.644485 4406 scope.go:122] "RemoveContainer" containerID="f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46" Oct 31 07:44:51.645468 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645445 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645618 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645599 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645703 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645686 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645852 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645831 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645896 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645956 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.645979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.645960 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.646151 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646019 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.646151 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646067 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.646151 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646140 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\") pod \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\" (UID: \"82209f94-5d4a-44f3-b89c-26cfe5963dfc\") " Oct 31 07:44:51.646368 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646148 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.646641 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646415 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.646989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.646960 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.647867 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.647942 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.647965 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.647990 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.648004 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.648019 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.648032 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.648052 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bct75\" (UniqueName: \"kubernetes.io/projected/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a-kube-api-access-bct75\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.650297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.648065 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.655520 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.655492 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:44:51.669719 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.669668 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "kube-api-access-zrrs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.673921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.673895 4406 scope.go:122] "RemoveContainer" containerID="f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46" Oct 31 07:44:51.674321 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:51.674296 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46\": container with ID starting with f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46 not found: ID does not exist" containerID="f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46" Oct 31 07:44:51.674402 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.674334 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46"} err="failed to get container status \"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46\": rpc error: code = NotFound desc = could not find container \"f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46\": container with ID starting with f9f5330a523823c518537cd9be3623915155c4d8a7c61506074777744137da46 not found: ID does not exist" Oct 31 07:44:51.674402 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.674360 4406 scope.go:122] "RemoveContainer" containerID="b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086" Oct 31 07:44:51.679688 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.679659 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:44:51.679792 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.679671 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo" pod "82209f94-5d4a-44f3-b89c-26cfe5963dfc" (UID: "82209f94-5d4a-44f3-b89c-26cfe5963dfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:44:51.684131 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.684112 4406 scope.go:122] "RemoveContainer" containerID="e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380" Oct 31 07:44:51.694079 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.694061 4406 scope.go:122] "RemoveContainer" containerID="b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086" Oct 31 07:44:51.694396 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:51.694376 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086\": container with ID starting with b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086 not found: ID does not exist" containerID="b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086" Oct 31 07:44:51.694462 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.694407 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086"} err="failed to get container status \"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086\": rpc error: code = NotFound desc = could not find container \"b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086\": container with ID starting with b3ffc793e706d80e5a22d43066604ab4dfe9d1e2403effda3b21ea6b58098086 not found: ID does not exist" Oct 31 07:44:51.694462 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.694434 4406 scope.go:122] "RemoveContainer" containerID="e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380" Oct 31 07:44:51.694708 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:51.694691 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380\": container with ID starting with e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380 not found: ID does not exist" containerID="e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380" Oct 31 07:44:51.694761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.694713 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380"} err="failed to get container status \"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380\": rpc error: code = NotFound desc = could not find container \"e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380\": container with ID starting with e3d032e4ce3d72d6add0e3a408e401b11d6da4e8ad267871372db57316b1c380 not found: ID does not exist" Oct 31 07:44:51.694761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.694727 4406 scope.go:122] "RemoveContainer" containerID="a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab" Oct 31 07:44:51.715197 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.715175 4406 scope.go:122] "RemoveContainer" containerID="a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab" Oct 31 07:44:51.715666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.715307 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:44:51.715725 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:44:51.715695 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab\": container with ID starting with a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab not found: ID does not exist" containerID="a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab" Oct 31 07:44:51.715774 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.715731 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab"} err="failed to get container status \"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab\": rpc error: code = NotFound desc = could not find container \"a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab\": container with ID starting with a90d1f0af6826c7c6d412ba1e89cc8cfd9caf875b2280edf41a1dfa4a8870cab not found: ID does not exist" Oct 31 07:44:51.727032 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.726650 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-84vh9"] Oct 31 07:44:51.750846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.750748 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrrs9\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-kube-api-access-zrrs9\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.750846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.750776 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.750846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.750800 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.750846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.750812 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.750846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.750823 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82209f94-5d4a-44f3-b89c-26cfe5963dfc-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:44:51.765748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.765720 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:44:51.772713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.772686 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-k8w2r"] Oct 31 07:44:51.818775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.818743 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:51.829047 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.829019 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-dwg4b"] Oct 31 07:44:51.997093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:51.997060 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:52.004535 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:52.004506 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-nhk7v"] Oct 31 07:44:53.602271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:53.592722 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79934771-5310-4f0d-b953-da23643fa0a6" path="/var/lib/kubelet/pods/79934771-5310-4f0d-b953-da23643fa0a6/volumes" Oct 31 07:44:53.602271 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:53.593525 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" path="/var/lib/kubelet/pods/82209f94-5d4a-44f3-b89c-26cfe5963dfc/volumes" Oct 31 07:44:53.618273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:53.615951 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" path="/var/lib/kubelet/pods/9df2bdd0-ab56-4443-b8ef-226466813d05/volumes" Oct 31 07:44:53.618273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:53.616825 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" path="/var/lib/kubelet/pods/d754be66-5b9c-4e39-80b1-4f4fa59a5e3a/volumes" Oct 31 07:44:55.271403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:55.271363 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:55.272081 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:55.272044 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:56.312686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.309924 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:56.484286 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.484222 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:56.486097 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.485529 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:56.848277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.829085 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": context deadline exceeded" Oct 31 07:44:56.892655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.892616 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:56.892829 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:56.892711 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:57.143358 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.140882 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:57.143358 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.140947 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:57.311273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.310402 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:57.311273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.311153 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:57.490331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.484428 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:57.490331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.486583 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:57.823324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.822806 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:44:57.823324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:57.822901 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:58.124281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.121488 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:44:58.152748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.152706 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": context deadline exceeded" Oct 31 07:44:58.158945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.158915 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:44:58.159150 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.159128 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:44:58.217009 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.216982 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:44:58.250192 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:44:58.248822 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:45:00.156727 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.156687 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:00.157465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157442 4406 cpu_manager.go:414] "containerMap: removing container" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" Oct 31 07:45:00.157465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157466 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157482 4406 cpu_manager.go:414] "containerMap: removing container" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157490 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157530 4406 cpu_manager.go:414] "containerMap: removing container" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157538 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157552 4406 cpu_manager.go:414] "containerMap: removing container" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157559 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157592 4406 cpu_manager.go:414] "containerMap: removing container" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" Oct 31 07:45:00.157632 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157600 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157705 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="82209f94-5d4a-44f3-b89c-26cfe5963dfc" containerName="istio-proxy" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157716 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157723 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="d754be66-5b9c-4e39-80b1-4f4fa59a5e3a" containerName="istio-proxy" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157734 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="992f19b3-a06c-4c02-a976-cf5f2f33f61a" containerName="payload-processing" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157744 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:00.157972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.157754 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="79934771-5310-4f0d-b953-da23643fa0a6" containerName="istio-proxy" Oct 31 07:45:00.163380 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.163355 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.178741 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.178714 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:00.249946 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.249912 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.250129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.250095 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjtt\" (UniqueName: \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.260711 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.260681 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\"" Oct 31 07:45:00.352367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.352332 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.352564 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.352449 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjtt\" (UniqueName: \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.352969 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.352947 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.370101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.370071 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjtt\" (UniqueName: \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\") pod \"maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.484140 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.484056 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:00.784591 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.784568 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:00.786998 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:45:00.786972 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7a9bd9_9237_4bc2_8a3f_06e1273a1b8f.slice/crio-2f745666009b200e5d97870dbeff1c7b55688b175a2dc16c98c33cd015a526af WatchSource:0}: Error finding container 2f745666009b200e5d97870dbeff1c7b55688b175a2dc16c98c33cd015a526af: Status 404 returned error can't find the container with id 2f745666009b200e5d97870dbeff1c7b55688b175a2dc16c98c33cd015a526af Oct 31 07:45:00.789451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:00.789434 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:45:01.066273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:01.066177 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:01.370331 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:01.363359 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" event={"ID":"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f","Type":"ContainerStarted","Data":"2f745666009b200e5d97870dbeff1c7b55688b175a2dc16c98c33cd015a526af"} Oct 31 07:45:05.422791 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.422748 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" event={"ID":"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f","Type":"ContainerStarted","Data":"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2"} Oct 31 07:45:05.423178 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.422833 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" podUID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" containerName="cleanup" containerID="cri-o://ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2" gracePeriod=30 Oct 31 07:45:05.461801 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.461745 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" podStartSLOduration=1.8892676179999999 podStartE2EDuration="5.461732502s" totalImagesPullingTime="3.572464884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:05.458607516 +0000 UTC m=+1012.105606810" watchObservedRunningTime="2026-10-31 07:45:05.461732502 +0000 UTC m=+1012.108731793" Oct 31 07:45:05.712988 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.712961 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:05.826550 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.826516 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\") pod \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " Oct 31 07:45:05.826749 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.826731 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\" (UniqueName: \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\") pod \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\" (UID: \"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f\") " Oct 31 07:45:05.826972 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.826941 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca" pod "cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" (UID: "cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:05.827414 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.827387 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-maas-api-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:05.829038 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.829007 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt" pod "cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" (UID: "cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f"). InnerVolumeSpecName "kube-api-access-5gjtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:05.928969 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:05.928865 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gjtt\" (UniqueName: \"kubernetes.io/projected/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f-kube-api-access-5gjtt\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:06.429664 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.429627 4406 generic.go:356] "Generic (PLEG): container finished" podID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" containerID="ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2" exitCode=6 Oct 31 07:45:06.430135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.429668 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" Oct 31 07:45:06.430135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.429716 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" event={"ID":"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f","Type":"ContainerDied","Data":"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2"} Oct 31 07:45:06.430135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.429776 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8" event={"ID":"cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f","Type":"ContainerDied","Data":"2f745666009b200e5d97870dbeff1c7b55688b175a2dc16c98c33cd015a526af"} Oct 31 07:45:06.430135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.429810 4406 scope.go:122] "RemoveContainer" containerID="ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2" Oct 31 07:45:06.441066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.441047 4406 scope.go:122] "RemoveContainer" containerID="ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2" Oct 31 07:45:06.441366 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:06.441346 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2\": container with ID starting with ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2 not found: ID does not exist" containerID="ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2" Oct 31 07:45:06.441437 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.441374 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2"} err="failed to get container status \"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2\": rpc error: code = NotFound desc = could not find container \"ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2\": container with ID starting with ac511acb26608ebd8e0ebc92d453b368c121cdbd0db763b592d4bb47608968b2 not found: ID does not exist" Oct 31 07:45:06.477655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.477627 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:06.487979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:06.487949 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8"] Oct 31 07:45:07.485744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:07.485713 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" path="/var/lib/kubelet/pods/cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f/volumes" Oct 31 07:45:09.357238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.356466 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:45:09.357238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.356811 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" containerID="cri-o://150838c74a9fca3b299542ce95a29933ee9464537327883ad44aa4fe95460c45" gracePeriod=30 Oct 31 07:45:09.377350 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.377318 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:45:09.377605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.377561 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" containerID="cri-o://fd86c96e01d4d86f4c761a9b181a7dbe5a1a82e35274cf7e42714c37126b5dfc" gracePeriod=30 Oct 31 07:45:09.382622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.382580 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:45:09.382971 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:09.382939 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" containerID="cri-o://a7c6f97f15ea72efb2e865d4ae4840973363258d442ba8b14918a7392d93d3f5" gracePeriod=30 Oct 31 07:45:09.992883 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:09.992842 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:45:10.572149 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:10.572112 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:45:10.572677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:10.572182 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:45:11.693846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:11.693812 4406 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:45:11.694352 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:11.693874 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:45:14.508976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.508942 4406 generic.go:356] "Generic (PLEG): container finished" podID="683d414d-d5d2-4e12-8384-682017ac615b" containerID="150838c74a9fca3b299542ce95a29933ee9464537327883ad44aa4fe95460c45" exitCode=0 Oct 31 07:45:14.509419 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.508987 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" event={"ID":"683d414d-d5d2-4e12-8384-682017ac615b","Type":"ContainerDied","Data":"150838c74a9fca3b299542ce95a29933ee9464537327883ad44aa4fe95460c45"} Oct 31 07:45:14.511907 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.511870 4406 generic.go:356] "Generic (PLEG): container finished" podID="f78966f9-8814-4336-ac82-c30f1115b67c" containerID="a7c6f97f15ea72efb2e865d4ae4840973363258d442ba8b14918a7392d93d3f5" exitCode=0 Oct 31 07:45:14.512030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.511930 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" event={"ID":"f78966f9-8814-4336-ac82-c30f1115b67c","Type":"ContainerDied","Data":"a7c6f97f15ea72efb2e865d4ae4840973363258d442ba8b14918a7392d93d3f5"} Oct 31 07:45:14.514150 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.514130 4406 generic.go:356] "Generic (PLEG): container finished" podID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerID="fd86c96e01d4d86f4c761a9b181a7dbe5a1a82e35274cf7e42714c37126b5dfc" exitCode=0 Oct 31 07:45:14.514291 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.514204 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" event={"ID":"3e521f36-93c6-4a5e-96d9-b8e075d7245f","Type":"ContainerDied","Data":"fd86c96e01d4d86f4c761a9b181a7dbe5a1a82e35274cf7e42714c37126b5dfc"} Oct 31 07:45:14.710288 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.707741 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:45:14.793820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.793797 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:45:14.798757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.798734 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:45:14.854825 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.854786 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.854854 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855010 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855043 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855163 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855102 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855177 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.855292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855189 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855243 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855309 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855349 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\") pod \"683d414d-d5d2-4e12-8384-682017ac615b\" (UID: \"683d414d-d5d2-4e12-8384-682017ac615b\") " Oct 31 07:45:14.855708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855680 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.855910 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855864 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.855997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.855917 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.856173 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.856151 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.856238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.856178 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.856238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.856193 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.856238 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.856206 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.856422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.856379 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:14.858610 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.858488 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:14.858784 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.858720 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "kube-api-access-dch56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:14.858973 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.858948 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:14.860569 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.860547 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy" pod "683d414d-d5d2-4e12-8384-682017ac615b" (UID: "683d414d-d5d2-4e12-8384-682017ac615b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.957761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957673 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.957761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957733 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.957994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957768 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.957994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957833 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.957994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957863 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.957994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957924 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.957994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.957980 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958005 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958041 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958070 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958129 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958178 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.958273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958233 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.958582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958236 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.958582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958368 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958446 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958487 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.958582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958554 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.958850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958594 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\") pod \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\" (UID: \"3e521f36-93c6-4a5e-96d9-b8e075d7245f\") " Oct 31 07:45:14.958850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958635 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\") pod \"f78966f9-8814-4336-ac82-c30f1115b67c\" (UID: \"f78966f9-8814-4336-ac82-c30f1115b67c\") " Oct 31 07:45:14.959475 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959447 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/683d414d-d5d2-4e12-8384-682017ac615b-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959479 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959495 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/683d414d-d5d2-4e12-8384-682017ac615b-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959509 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959522 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dch56\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-kube-api-access-dch56\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959536 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/683d414d-d5d2-4e12-8384-682017ac615b-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959598 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959549 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/683d414d-d5d2-4e12-8384-682017ac615b-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958476 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958576 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958769 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.958825 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959122 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959752 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959409 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.959979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.959364 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.960594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.960569 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.962439 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.962391 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:14.962439 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.962415 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "kube-api-access-plp9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:14.962439 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.962419 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:14.962954 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.962933 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:14.963779 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.963761 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "kube-api-access-2jvnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:14.963969 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.963945 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo" pod "3e521f36-93c6-4a5e-96d9-b8e075d7245f" (UID: "3e521f36-93c6-4a5e-96d9-b8e075d7245f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:14.964091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:14.964069 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token" pod "f78966f9-8814-4336-ac82-c30f1115b67c" (UID: "f78966f9-8814-4336-ac82-c30f1115b67c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:15.060497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060467 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060493 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060497 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060505 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060514 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060524 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78966f9-8814-4336-ac82-c30f1115b67c-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060532 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060540 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060549 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060557 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060564 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78966f9-8814-4336-ac82-c30f1115b67c-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060574 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jvnd\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-kube-api-access-2jvnd\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060582 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e521f36-93c6-4a5e-96d9-b8e075d7245f-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060591 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060599 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plp9f\" (UniqueName: \"kubernetes.io/projected/f78966f9-8814-4336-ac82-c30f1115b67c-kube-api-access-plp9f\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060606 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e521f36-93c6-4a5e-96d9-b8e075d7245f-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.060739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.060614 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78966f9-8814-4336-ac82-c30f1115b67c-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:15.521847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.521824 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" Oct 31 07:45:15.522232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.521823 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k" event={"ID":"683d414d-d5d2-4e12-8384-682017ac615b","Type":"ContainerDied","Data":"029cfcf239bb69da50ddccc886c531e6e75020978f19d7d6f7355b64dc2bdb7a"} Oct 31 07:45:15.522232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.521983 4406 scope.go:122] "RemoveContainer" containerID="150838c74a9fca3b299542ce95a29933ee9464537327883ad44aa4fe95460c45" Oct 31 07:45:15.523423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.523395 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" Oct 31 07:45:15.523423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.523410 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt" event={"ID":"f78966f9-8814-4336-ac82-c30f1115b67c","Type":"ContainerDied","Data":"dcd235c73a6734fa3ace0dbc465b427dabb268742b7167fb6895a8d1a099175f"} Oct 31 07:45:15.525063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.525045 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" Oct 31 07:45:15.525063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.525052 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km" event={"ID":"3e521f36-93c6-4a5e-96d9-b8e075d7245f","Type":"ContainerDied","Data":"b25e7de57fbd29eef6f7fd62a5cb364a9e25095b27676e6ec4aa27cff858d864"} Oct 31 07:45:15.532306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.532291 4406 scope.go:122] "RemoveContainer" containerID="a7c6f97f15ea72efb2e865d4ae4840973363258d442ba8b14918a7392d93d3f5" Oct 31 07:45:15.540785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.540769 4406 scope.go:122] "RemoveContainer" containerID="fd86c96e01d4d86f4c761a9b181a7dbe5a1a82e35274cf7e42714c37126b5dfc" Oct 31 07:45:15.624272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.618003 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:45:15.639279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.635100 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-h25km"] Oct 31 07:45:15.664318 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.661501 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:45:15.664625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.664602 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-cv85k"] Oct 31 07:45:15.690269 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.689320 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:45:15.691872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:15.691844 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-9d8qt"] Oct 31 07:45:17.477861 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:17.477829 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" path="/var/lib/kubelet/pods/3e521f36-93c6-4a5e-96d9-b8e075d7245f/volumes" Oct 31 07:45:17.478310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:17.478294 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="683d414d-d5d2-4e12-8384-682017ac615b" path="/var/lib/kubelet/pods/683d414d-d5d2-4e12-8384-682017ac615b/volumes" Oct 31 07:45:17.478735 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:17.478722 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" path="/var/lib/kubelet/pods/f78966f9-8814-4336-ac82-c30f1115b67c/volumes" Oct 31 07:45:18.405949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.405913 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:45:18.406463 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.406429 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" podUID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" containerName="maas-api" containerID="cri-o://aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026" gracePeriod=30 Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.958555 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959624 4406 cpu_manager.go:414] "containerMap: removing container" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959649 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959666 4406 cpu_manager.go:414] "containerMap: removing container" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959675 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9df2bdd0-ab56-4443-b8ef-226466813d05" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959694 4406 cpu_manager.go:414] "containerMap: removing container" podUID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" containerName="cleanup" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959703 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" containerName="cleanup" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959745 4406 cpu_manager.go:414] "containerMap: removing container" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959752 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959764 4406 cpu_manager.go:414] "containerMap: removing container" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959772 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959954 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb7a9bd9-9237-4bc2-8a3f-06e1273a1b8f" containerName="cleanup" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959983 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="683d414d-d5d2-4e12-8384-682017ac615b" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.959994 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="f78966f9-8814-4336-ac82-c30f1115b67c" containerName="istio-proxy" Oct 31 07:45:18.965274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.960012 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e521f36-93c6-4a5e-96d9-b8e075d7245f" containerName="istio-proxy" Oct 31 07:45:18.988306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:18.970983 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.108274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.099373 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.141059 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165364 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qprrx\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165413 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165467 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165594 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165785 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165813 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165899 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.190465 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.165949 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.267815 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.267880 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.267905 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qprrx\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.267926 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.267957 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.268016 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.268112 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.268129 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.268316 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.268172 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.269860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.268953 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.269860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.269006 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.269860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.269557 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.269860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.269637 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.269860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.269778 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.274295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.272397 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.281574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.281543 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.286905 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.286811 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.289423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.289395 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qprrx\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.363565 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.363534 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:19.779262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.779211 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:45:19.785536 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:45:19.785496 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96281577_b4a6_4cd2_b6ce_f6b1d10d1204.slice/crio-800f466861ec2e51e9646c795399655d6b2923b73286cefbf66f65476a05d49b WatchSource:0}: Error finding container 800f466861ec2e51e9646c795399655d6b2923b73286cefbf66f65476a05d49b: Status 404 returned error can't find the container with id 800f466861ec2e51e9646c795399655d6b2923b73286cefbf66f65476a05d49b Oct 31 07:45:19.788114 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.788080 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:45:19.788208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.788153 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:45:19.788208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.788188 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:45:19.823375 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.823346 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:45:19.922095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.921998 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\") pod \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " Oct 31 07:45:19.922095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.922053 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\") pod \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " Oct 31 07:45:19.922335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.922107 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\" (UniqueName: \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\") pod \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " Oct 31 07:45:19.922335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.922221 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\") pod \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\" (UID: \"7c7c760d-efb8-4e34-ac8b-0202884bbcd1\") " Oct 31 07:45:19.926046 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.925921 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca" pod "7c7c760d-efb8-4e34-ac8b-0202884bbcd1" (UID: "7c7c760d-efb8-4e34-ac8b-0202884bbcd1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:19.926046 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.926014 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls" pod "7c7c760d-efb8-4e34-ac8b-0202884bbcd1" (UID: "7c7c760d-efb8-4e34-ac8b-0202884bbcd1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:19.926983 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.926754 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb" pod "7c7c760d-efb8-4e34-ac8b-0202884bbcd1" (UID: "7c7c760d-efb8-4e34-ac8b-0202884bbcd1"). InnerVolumeSpecName "kube-api-access-dsbdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:19.928184 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:19.928159 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs" pod "7c7c760d-efb8-4e34-ac8b-0202884bbcd1" (UID: "7c7c760d-efb8-4e34-ac8b-0202884bbcd1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:20.027622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.027519 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:20.027622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.027560 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:20.027622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.027575 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsbdb\" (UniqueName: \"kubernetes.io/projected/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-kube-api-access-dsbdb\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:20.027622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.027588 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c7c760d-efb8-4e34-ac8b-0202884bbcd1-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:20.657579 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.657534 4406 generic.go:356] "Generic (PLEG): container finished" podID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" containerID="aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026" exitCode=0 Oct 31 07:45:20.657987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.657965 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" event={"ID":"7c7c760d-efb8-4e34-ac8b-0202884bbcd1","Type":"ContainerDied","Data":"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026"} Oct 31 07:45:20.658179 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.658164 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" event={"ID":"7c7c760d-efb8-4e34-ac8b-0202884bbcd1","Type":"ContainerDied","Data":"c60a78c152cebdef14fbc852e46006fc9deeea7ac017a95442270d164412d770"} Oct 31 07:45:20.658334 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.658320 4406 scope.go:122] "RemoveContainer" containerID="aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026" Oct 31 07:45:20.658617 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.658600 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp" Oct 31 07:45:20.662568 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.662543 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" event={"ID":"96281577-b4a6-4cd2-b6ce-f6b1d10d1204","Type":"ContainerStarted","Data":"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0"} Oct 31 07:45:20.662766 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.662732 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" event={"ID":"96281577-b4a6-4cd2-b6ce-f6b1d10d1204","Type":"ContainerStarted","Data":"800f466861ec2e51e9646c795399655d6b2923b73286cefbf66f65476a05d49b"} Oct 31 07:45:20.677267 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.677101 4406 scope.go:122] "RemoveContainer" containerID="aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026" Oct 31 07:45:20.677517 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:20.677490 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026\": container with ID starting with aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026 not found: ID does not exist" containerID="aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026" Oct 31 07:45:20.677588 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.677530 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026"} err="failed to get container status \"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026\": rpc error: code = NotFound desc = could not find container \"aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026\": container with ID starting with aa139b05e077d36e2be33a63f383d6b283327f835636d2955a5e442b0ee49026 not found: ID does not exist" Oct 31 07:45:20.728631 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.728563 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podStartSLOduration=2.728540241 podStartE2EDuration="2.728540241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:20.723570384 +0000 UTC m=+1027.370569666" watchObservedRunningTime="2026-10-31 07:45:20.728540241 +0000 UTC m=+1027.375539524" Oct 31 07:45:20.760135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.760103 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:45:20.766078 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:20.766050 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp"] Oct 31 07:45:21.366335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:21.366185 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:21.367131 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:21.367109 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:21.367190 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:21.367162 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:21.593994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:21.593953 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" path="/var/lib/kubelet/pods/7c7c760d-efb8-4e34-ac8b-0202884bbcd1/volumes" Oct 31 07:45:22.364413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:22.364381 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:22.364584 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:22.364442 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:23.364209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:23.364172 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:23.364620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:23.364272 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:24.372830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:24.368619 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:24.372830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:24.368700 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:25.230270 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:25.226493 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:25.372273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:25.371724 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:25.372273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:25.371788 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:26.132843 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:26.132559 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:26.269293 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:26.252378 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:26.468332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:26.467816 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:26.468332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:26.467888 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:26.666281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:26.665535 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:27.133771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.133729 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:45:27.158234 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.158201 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:45:27.221579 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.218038 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:45:27.258422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.238535 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:27.296870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.265379 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:27.296870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.265784 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:45:27.417381 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.417295 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:27.417624 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.417595 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:27.453282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.451321 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:45:27.764771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.639693 4406 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:45:27.764771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:27.639748 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:28.079748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.066422 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:45:28.079748 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.066490 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:28.137508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.137462 4406 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": context deadline exceeded" Oct 31 07:45:28.193272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.168349 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:28.193272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.174311 4406 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 07:45:28.213277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.206385 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:45:28.270276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.266490 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:28.301477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.301428 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:45:28.314302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.313316 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:45:28.364930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.364831 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:28.365201 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.365158 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:28.365975 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.365950 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" containerID="cri-o://63500db1619d9c8ccccc7c60570c62265ab9fea8fb7ed621e7dea0e234870aca" gracePeriod=30 Oct 31 07:45:28.377101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.376809 4406 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:45:28.377101 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.376866 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:28.563728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.563692 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:45:28.567572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:28.567530 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" containerID="cri-o://f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c" gracePeriod=30 Oct 31 07:45:29.133274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.128241 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:45:29.133274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.128625 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" containerID="cri-o://df111413f403b74fe4a452a423f419db29abacc7e8e859aae27281dcec46bbe1" gracePeriod=30 Oct 31 07:45:29.170660 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.170618 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 31 07:45:29.172276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.172234 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:45:29.183625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.183587 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" containerID="cri-o://cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1" gracePeriod=30 Oct 31 07:45:29.367281 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.354141 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:29.466359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.359821 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded" Oct 31 07:45:29.490755 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.444287 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:29.491103 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:29.491074 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:30.177275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.176757 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 07:45:30.353116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.353077 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:45:30.365820 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.365789 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:45:30.367047 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.367019 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body= Oct 31 07:45:30.367243 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.367221 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" Oct 31 07:45:30.471686 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:30.471602 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:45:31.745263 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:31.745207 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:31.747522 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:31.747364 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:31.748750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:31.748734 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:45:34.074757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.074728 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.204765 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.204857 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.204935 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.204964 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.205042 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.205115 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.210289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.205181 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.225347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.210884 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.225347 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.210991 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\") pod \"d3e4deff-f3d9-4a62-b21e-39420747cb23\" (UID: \"d3e4deff-f3d9-4a62-b21e-39420747cb23\") " Oct 31 07:45:34.226004 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.225646 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.239066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.238622 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.239066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.238810 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.239393 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.239334 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.251230 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.239695 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:34.256292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.253857 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:34.256544 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.256522 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "kube-api-access-zncnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:34.256680 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.256658 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.258168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.258141 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token" pod "d3e4deff-f3d9-4a62-b21e-39420747cb23" (UID: "d3e4deff-f3d9-4a62-b21e-39420747cb23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316224 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316314 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316331 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316346 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4deff-f3d9-4a62-b21e-39420747cb23-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316359 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316374 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zncnm\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-kube-api-access-zncnm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316391 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316406 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4deff-f3d9-4a62-b21e-39420747cb23-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.316549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.316420 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4deff-f3d9-4a62-b21e-39420747cb23-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.738702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.738660 4406 generic.go:356] "Generic (PLEG): container finished" podID="3a50b861-b673-406c-9a55-e27a5261bc29" containerID="63500db1619d9c8ccccc7c60570c62265ab9fea8fb7ed621e7dea0e234870aca" exitCode=0 Oct 31 07:45:34.738997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.738976 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" event={"ID":"3a50b861-b673-406c-9a55-e27a5261bc29","Type":"ContainerDied","Data":"63500db1619d9c8ccccc7c60570c62265ab9fea8fb7ed621e7dea0e234870aca"} Oct 31 07:45:34.741367 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.741333 4406 generic.go:356] "Generic (PLEG): container finished" podID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerID="f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c" exitCode=0 Oct 31 07:45:34.741699 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.741684 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" event={"ID":"d3e4deff-f3d9-4a62-b21e-39420747cb23","Type":"ContainerDied","Data":"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c"} Oct 31 07:45:34.741830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.741817 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" event={"ID":"d3e4deff-f3d9-4a62-b21e-39420747cb23","Type":"ContainerDied","Data":"d180a9cc211fda07286aade9aeb687691ad415c753aca1e4259d2e547e2ee921"} Oct 31 07:45:34.741925 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.741916 4406 scope.go:122] "RemoveContainer" containerID="f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c" Oct 31 07:45:34.742160 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.742147 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz" Oct 31 07:45:34.770914 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.769057 4406 generic.go:356] "Generic (PLEG): container finished" podID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerID="df111413f403b74fe4a452a423f419db29abacc7e8e859aae27281dcec46bbe1" exitCode=0 Oct 31 07:45:34.770914 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.769138 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" event={"ID":"f1a9ed28-11cb-4b5c-9616-01ddf2136d19","Type":"ContainerDied","Data":"df111413f403b74fe4a452a423f419db29abacc7e8e859aae27281dcec46bbe1"} Oct 31 07:45:34.779770 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.779744 4406 scope.go:122] "RemoveContainer" containerID="f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c" Oct 31 07:45:34.780355 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:34.780208 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c\": container with ID starting with f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c not found: ID does not exist" containerID="f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c" Oct 31 07:45:34.780355 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.780264 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c"} err="failed to get container status \"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c\": rpc error: code = NotFound desc = could not find container \"f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c\": container with ID starting with f23f98173c51d1ff65f9581e31de4df7b28bf18b76d2991eb832782a3d6ca73c not found: ID does not exist" Oct 31 07:45:34.795333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.794683 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:45:34.829302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.813125 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:45:34.829302 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.817377 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-7xhhz"] Oct 31 07:45:34.942359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.942016 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.942359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.942130 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.942359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.942168 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.942359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.942218 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.944665 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.943532 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.944665 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.943803 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.945137 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.944908 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.945219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.945198 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.945350 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.945336 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.945476 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.945455 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.945608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.945540 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.945608 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.945579 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\") pod \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\" (UID: \"f1a9ed28-11cb-4b5c-9616-01ddf2136d19\") " Oct 31 07:45:34.946080 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946056 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:34.946500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946420 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.946646 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946630 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.946737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946647 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.946737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946656 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.946737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946666 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.946737 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.946675 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:34.950931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.950908 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:45:34.951859 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.951802 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "kube-api-access-bxjpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:34.952369 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.952342 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:34.953891 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.953868 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:34.954274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:34.954226 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo" pod "f1a9ed28-11cb-4b5c-9616-01ddf2136d19" (UID: "f1a9ed28-11cb-4b5c-9616-01ddf2136d19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:35.047903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.047820 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.047903 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.047874 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.047918 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048028 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048067 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048156 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048193 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048232 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.048500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048403 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\") pod \"3a50b861-b673-406c-9a55-e27a5261bc29\" (UID: \"3a50b861-b673-406c-9a55-e27a5261bc29\") " Oct 31 07:45:35.049265 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048969 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.049265 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.048992 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjpc\" (UniqueName: \"kubernetes.io/projected/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-kube-api-access-bxjpc\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.049265 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.049006 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.049265 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.049019 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1a9ed28-11cb-4b5c-9616-01ddf2136d19-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.049716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.049688 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:35.050548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.050123 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.050548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.050331 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.050548 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.050519 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.050803 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.050647 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.053025 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.052987 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.053123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.053076 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:35.053123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.053088 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:35.057392 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.057365 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc" pod "3a50b861-b673-406c-9a55-e27a5261bc29" (UID: "3a50b861-b673-406c-9a55-e27a5261bc29"). InnerVolumeSpecName "kube-api-access-bb9bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:35.093867 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.093847 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:45:35.149706 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149670 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.149892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149732 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.149892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149774 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.149892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149852 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149893 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149977 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.149987 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.150056 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150020 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150315 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150076 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.150315 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150145 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150315 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150207 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\") pod \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\" (UID: \"5e63e3d5-033c-4870-a00f-3fc867b8ae41\") " Oct 31 07:45:35.150494 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150345 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150857 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a50b861-b673-406c-9a55-e27a5261bc29-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150884 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150899 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150912 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150926 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150938 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150950 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150963 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150977 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a50b861-b673-406c-9a55-e27a5261bc29-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150992 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb9bc\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-kube-api-access-bb9bc\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.151006 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a50b861-b673-406c-9a55-e27a5261bc29-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.151021 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a50b861-b673-406c-9a55-e27a5261bc29-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150971 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:35.151065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.150963 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.153119 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.152860 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:35.153404 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.153377 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:35.154170 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.154147 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:35.154422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.154404 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q" pod "5e63e3d5-033c-4870-a00f-3fc867b8ae41" (UID: "5e63e3d5-033c-4870-a00f-3fc867b8ae41"). InnerVolumeSpecName "kube-api-access-t7c2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:35.252570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252543 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.252570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252569 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.252570 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252580 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.252837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252588 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7c2q\" (UniqueName: \"kubernetes.io/projected/5e63e3d5-033c-4870-a00f-3fc867b8ae41-kube-api-access-t7c2q\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.252837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252597 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.252837 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.252605 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e63e3d5-033c-4870-a00f-3fc867b8ae41-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:35.479102 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.479069 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" path="/var/lib/kubelet/pods/d3e4deff-f3d9-4a62-b21e-39420747cb23/volumes" Oct 31 07:45:35.776059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.775975 4406 generic.go:356] "Generic (PLEG): container finished" podID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerID="cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1" exitCode=0 Oct 31 07:45:35.776059 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.776034 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" Oct 31 07:45:35.776324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.776065 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" event={"ID":"5e63e3d5-033c-4870-a00f-3fc867b8ae41","Type":"ContainerDied","Data":"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1"} Oct 31 07:45:35.776324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.776124 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c" event={"ID":"5e63e3d5-033c-4870-a00f-3fc867b8ae41","Type":"ContainerDied","Data":"5a1c978cf473c81ddcb9cc5509e52486e0291cfe302e9ee57861edc227936304"} Oct 31 07:45:35.776324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.776159 4406 scope.go:122] "RemoveContainer" containerID="cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1" Oct 31 07:45:35.777670 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.777652 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" Oct 31 07:45:35.777785 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.777687 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f" event={"ID":"f1a9ed28-11cb-4b5c-9616-01ddf2136d19","Type":"ContainerDied","Data":"8e89baf90ba57d715a472f2893562daa7dde46638061261fd20727c80d22bbc1"} Oct 31 07:45:35.779326 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.779305 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" Oct 31 07:45:35.779436 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.779325 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv" event={"ID":"3a50b861-b673-406c-9a55-e27a5261bc29","Type":"ContainerDied","Data":"39c9054f27a6af68d383aedf56f3d5fa467ee696c0f184b0c1da8542f67c1247"} Oct 31 07:45:35.789403 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.789379 4406 scope.go:122] "RemoveContainer" containerID="cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1" Oct 31 07:45:35.789722 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:35.789694 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1\": container with ID starting with cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1 not found: ID does not exist" containerID="cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1" Oct 31 07:45:35.789841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.789727 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1"} err="failed to get container status \"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1\": rpc error: code = NotFound desc = could not find container \"cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1\": container with ID starting with cb72d4800e9ea52b91bc36cb7d9db5f247589b5b314619c3a5c62d14550ee5f1 not found: ID does not exist" Oct 31 07:45:35.789841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.789744 4406 scope.go:122] "RemoveContainer" containerID="df111413f403b74fe4a452a423f419db29abacc7e8e859aae27281dcec46bbe1" Oct 31 07:45:35.798208 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.798192 4406 scope.go:122] "RemoveContainer" containerID="63500db1619d9c8ccccc7c60570c62265ab9fea8fb7ed621e7dea0e234870aca" Oct 31 07:45:35.825401 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.825304 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:45:35.835678 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.835655 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-kkpgv"] Oct 31 07:45:35.865397 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.865369 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:45:35.869609 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.869585 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-tbn8c"] Oct 31 07:45:35.899363 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.899342 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:45:35.904846 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:35.904823 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-2kz6f"] Oct 31 07:45:36.442995 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.442956 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:45:36.443886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.443828 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" podUID="17f81653-6f76-4ad3-9d2e-eaa881bca454" containerName="maas-api" containerID="cri-o://deb4e7307bc90e1ca2561bab61ae4b52acd8edffcb99915b576446c374280152" gracePeriod=30 Oct 31 07:45:36.792557 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.792524 4406 generic.go:356] "Generic (PLEG): container finished" podID="17f81653-6f76-4ad3-9d2e-eaa881bca454" containerID="deb4e7307bc90e1ca2561bab61ae4b52acd8edffcb99915b576446c374280152" exitCode=0 Oct 31 07:45:36.792742 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.792600 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" event={"ID":"17f81653-6f76-4ad3-9d2e-eaa881bca454","Type":"ContainerDied","Data":"deb4e7307bc90e1ca2561bab61ae4b52acd8edffcb99915b576446c374280152"} Oct 31 07:45:36.837464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.837290 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:45:36.902188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.902149 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\" (UniqueName: \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\") pod \"17f81653-6f76-4ad3-9d2e-eaa881bca454\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " Oct 31 07:45:36.902188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.902202 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\") pod \"17f81653-6f76-4ad3-9d2e-eaa881bca454\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " Oct 31 07:45:36.902459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.902307 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\") pod \"17f81653-6f76-4ad3-9d2e-eaa881bca454\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " Oct 31 07:45:36.902624 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.902602 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\") pod \"17f81653-6f76-4ad3-9d2e-eaa881bca454\" (UID: \"17f81653-6f76-4ad3-9d2e-eaa881bca454\") " Oct 31 07:45:36.903134 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.903091 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca" pod "17f81653-6f76-4ad3-9d2e-eaa881bca454" (UID: "17f81653-6f76-4ad3-9d2e-eaa881bca454"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:36.905364 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.905268 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw" pod "17f81653-6f76-4ad3-9d2e-eaa881bca454" (UID: "17f81653-6f76-4ad3-9d2e-eaa881bca454"). InnerVolumeSpecName "kube-api-access-lnsdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:36.905499 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.905478 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls" pod "17f81653-6f76-4ad3-9d2e-eaa881bca454" (UID: "17f81653-6f76-4ad3-9d2e-eaa881bca454"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:36.905889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:36.905862 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs" pod "17f81653-6f76-4ad3-9d2e-eaa881bca454" (UID: "17f81653-6f76-4ad3-9d2e-eaa881bca454"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:37.025429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.012311 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f81653-6f76-4ad3-9d2e-eaa881bca454-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:37.025429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.012348 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnsdw\" (UniqueName: \"kubernetes.io/projected/17f81653-6f76-4ad3-9d2e-eaa881bca454-kube-api-access-lnsdw\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:37.025429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.012364 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:37.025429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.012379 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f81653-6f76-4ad3-9d2e-eaa881bca454-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:37.481593 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.481564 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" path="/var/lib/kubelet/pods/3a50b861-b673-406c-9a55-e27a5261bc29/volumes" Oct 31 07:45:37.482111 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.482088 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" path="/var/lib/kubelet/pods/5e63e3d5-033c-4870-a00f-3fc867b8ae41/volumes" Oct 31 07:45:37.482704 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.482683 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" path="/var/lib/kubelet/pods/f1a9ed28-11cb-4b5c-9616-01ddf2136d19/volumes" Oct 31 07:45:37.801760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.801670 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" event={"ID":"17f81653-6f76-4ad3-9d2e-eaa881bca454","Type":"ContainerDied","Data":"7c0bd5220351adc0e089b4ef9ce870ae41b9175c8da33693ffecd75268ead194"} Oct 31 07:45:37.801760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.801750 4406 scope.go:122] "RemoveContainer" containerID="deb4e7307bc90e1ca2561bab61ae4b52acd8edffcb99915b576446c374280152" Oct 31 07:45:37.801955 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.801688 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd" Oct 31 07:45:37.849141 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.849106 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:45:37.859879 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:37.859849 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd"] Oct 31 07:45:39.563099 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:39.563057 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17f81653-6f76-4ad3-9d2e-eaa881bca454" path="/var/lib/kubelet/pods/17f81653-6f76-4ad3-9d2e-eaa881bca454/volumes" Oct 31 07:45:40.265300 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:40.264942 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:45:43.524320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.522501 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:45:43.524320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.522761 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" containerID="cri-o://cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d" gracePeriod=30 Oct 31 07:45:43.530500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.530426 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:45:43.530729 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.530684 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" containerID="cri-o://5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06" gracePeriod=30 Oct 31 07:45:43.534670 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.534615 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:45:43.534845 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:43.534819 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" containerID="cri-o://6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc" gracePeriod=30 Oct 31 07:45:44.218306 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.218267 4406 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:45:44.218495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.218350 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:45:44.829767 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.829729 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:45:44.830200 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.829994 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" containerID="cri-o://be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf" gracePeriod=30 Oct 31 07:45:44.837307 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.837277 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:45:44.837578 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.837539 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" containerID="cri-o://84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2" gracePeriod=30 Oct 31 07:45:44.840670 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.840639 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:45:44.840842 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.840816 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" containerID="cri-o://5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0" gracePeriod=30 Oct 31 07:45:44.845209 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.845185 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:45:44.845545 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:44.845520 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" containerID="cri-o://94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f" gracePeriod=30 Oct 31 07:45:45.059760 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.059720 4406 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:45:45.060106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.060075 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:45:45.418600 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.418543 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" containerID="cri-o://1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33" gracePeriod=43 Oct 31 07:45:45.418796 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.418715 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" containerID="cri-o://8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2" gracePeriod=42 Oct 31 07:45:45.699693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.699662 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:45:45.727581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.727558 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:45:45.841985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.841946 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\" (UniqueName: \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842007 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\" (UniqueName: \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842094 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842123 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842185 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842215 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842353 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.842755 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842449 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.842811 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842775 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.842863 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842826 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842863 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842855 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\") pod \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\" (UID: \"ad7ffb31-b09f-4833-b4a3-1ca70838af37\") " Oct 31 07:45:45.842976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842887 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\" (UniqueName: \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.842976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842949 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.843078 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.842980 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\") pod \"36a8269e-a81e-413d-b354-adbb5ff46faa\" (UID: \"36a8269e-a81e-413d-b354-adbb5ff46faa\") " Oct 31 07:45:45.843572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.843549 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.843572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.843573 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.844373 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844064 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.844373 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844318 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.844373 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844339 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.844574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844395 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.844574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844473 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "kube-api-access-nmn97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:45.844574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844525 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:45.844574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844534 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.844708 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.844612 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs" pod "ad7ffb31-b09f-4833-b4a3-1ca70838af37" (UID: "ad7ffb31-b09f-4833-b4a3-1ca70838af37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:45.845906 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.845886 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "kube-api-access-mrvhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:45.846229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.846211 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm" pod "36a8269e-a81e-413d-b354-adbb5ff46faa" (UID: "36a8269e-a81e-413d-b354-adbb5ff46faa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945522 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945561 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945574 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945586 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945599 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7ffb31-b09f-4833-b4a3-1ca70838af37-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.945612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945612 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrvhn\" (UniqueName: \"kubernetes.io/projected/36a8269e-a81e-413d-b354-adbb5ff46faa-kube-api-access-mrvhn\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.946037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945626 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.946037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945639 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a8269e-a81e-413d-b354-adbb5ff46faa-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.946037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945653 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a8269e-a81e-413d-b354-adbb5ff46faa-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:45.946037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:45.945667 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmn97\" (UniqueName: \"kubernetes.io/projected/ad7ffb31-b09f-4833-b4a3-1ca70838af37-kube-api-access-nmn97\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:46.316469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.316357 4406 generic.go:356] "Generic (PLEG): container finished" podID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerID="8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2" exitCode=0 Oct 31 07:45:46.316469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.316409 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" Oct 31 07:45:46.316469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.316444 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" event={"ID":"ad7ffb31-b09f-4833-b4a3-1ca70838af37","Type":"ContainerDied","Data":"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2"} Oct 31 07:45:46.316746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.316505 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt" event={"ID":"ad7ffb31-b09f-4833-b4a3-1ca70838af37","Type":"ContainerDied","Data":"10cfb55bde218232eced0770a30b1c8c86cea810c362eeb12277d9dd9acf42b1"} Oct 31 07:45:46.316746 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.316529 4406 scope.go:122] "RemoveContainer" containerID="8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2" Oct 31 07:45:46.318091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.317981 4406 generic.go:356] "Generic (PLEG): container finished" podID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerID="1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33" exitCode=0 Oct 31 07:45:46.318091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.318040 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" event={"ID":"36a8269e-a81e-413d-b354-adbb5ff46faa","Type":"ContainerDied","Data":"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33"} Oct 31 07:45:46.318091 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.318064 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" event={"ID":"36a8269e-a81e-413d-b354-adbb5ff46faa","Type":"ContainerDied","Data":"c6bd25a7f03fb5e48c4e804bf5d782934e2eaacd3e239defe18e90c7838adbab"} Oct 31 07:45:46.318289 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.318106 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr" Oct 31 07:45:46.328942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.328924 4406 scope.go:122] "RemoveContainer" containerID="8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2" Oct 31 07:45:46.329517 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:46.329496 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2\": container with ID starting with 8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2 not found: ID does not exist" containerID="8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2" Oct 31 07:45:46.329614 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.329526 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2"} err="failed to get container status \"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2\": rpc error: code = NotFound desc = could not find container \"8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2\": container with ID starting with 8231803e3e0687c0fee17cb929cd922b5d1c6e67ce63b7a6efe016f314647af2 not found: ID does not exist" Oct 31 07:45:46.329614 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.329542 4406 scope.go:122] "RemoveContainer" containerID="1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33" Oct 31 07:45:46.338166 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.338149 4406 scope.go:122] "RemoveContainer" containerID="1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33" Oct 31 07:45:46.338438 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:46.338418 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33\": container with ID starting with 1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33 not found: ID does not exist" containerID="1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33" Oct 31 07:45:46.338496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.338445 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33"} err="failed to get container status \"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33\": rpc error: code = NotFound desc = could not find container \"1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33\": container with ID starting with 1074e50d9e5372bd51f39ef3d6c7f36109967aebc21e6ba8351c78e5aa0f4b33 not found: ID does not exist" Oct 31 07:45:46.365508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.365479 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:45:46.376023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.375998 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/premium-w1-4794f5-kserve-58864d75bb-jf9dr"] Oct 31 07:45:46.396990 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.396959 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:45:46.399571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:46.399548 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-2-w1-4794f5-kserve-78b67d7f8-wj6xt"] Oct 31 07:45:47.477772 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:47.477736 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" path="/var/lib/kubelet/pods/36a8269e-a81e-413d-b354-adbb5ff46faa/volumes" Oct 31 07:45:47.478413 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:47.478389 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" path="/var/lib/kubelet/pods/ad7ffb31-b09f-4833-b4a3-1ca70838af37/volumes" Oct 31 07:45:48.930595 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:48.930565 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:45:48.967332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:48.967311 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:45:48.971554 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:48.971530 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:45:49.084935 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.084898 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.085115 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.084954 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.085115 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085044 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.085115 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085111 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.085330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085158 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.085330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085203 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.085330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085244 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.085330 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085301 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.085542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085335 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.085542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085356 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.085700 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085409 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:49.085839 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085659 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.085919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085385 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.085919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085879 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.085919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085895 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086076 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.085949 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086076 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086019 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086076 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086070 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.086227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086087 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.086227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086109 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086141 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086178 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.086227 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086216 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\") pod \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\" (UID: \"ed6c2745-17b7-4498-ae5e-1cad862c25fe\") " Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086283 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086326 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086326 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086355 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086405 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.086503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086449 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086519 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086562 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086603 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\") pod \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\" (UID: \"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0\") " Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086651 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086679 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.086800 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.086713 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\") pod \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\" (UID: \"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d\") " Oct 31 07:45:49.087334 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.087307 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.087574 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.087554 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.088296 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.088223 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.088984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.088951 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:49.089469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.089449 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.090132 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.090000 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.090606 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.090274 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.091690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.091612 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.091690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.091637 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.091690 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.091651 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.091663 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092568 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092594 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092610 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092624 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092638 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092651 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092665 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092681 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092696 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092710 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.092769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.092725 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.093980 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.093622 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.093980 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.093683 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:49.095295 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095219 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:49.095407 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095291 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.095407 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095340 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "kube-api-access-sm5cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.095523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095427 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt" pod "ed6c2745-17b7-4498-ae5e-1cad862c25fe" (UID: "ed6c2745-17b7-4498-ae5e-1cad862c25fe"). InnerVolumeSpecName "kube-api-access-cvgwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.095739 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095696 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.095944 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.095879 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:49.096449 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.096412 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.096694 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.096672 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy" pod "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" (UID: "a36e2b6a-293d-441c-a4b0-11cebaf0ccf0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.096911 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.096884 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:49.097093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.097073 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m" pod "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" (UID: "03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d"). InnerVolumeSpecName "kube-api-access-2t67m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:49.193765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193732 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193765 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193760 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193782 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm5cn\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-kube-api-access-sm5cn\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193794 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193806 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193816 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193827 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvgwt\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-kube-api-access-cvgwt\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193839 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t67m\" (UniqueName: \"kubernetes.io/projected/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-kube-api-access-2t67m\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193850 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193861 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193872 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.193951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.193884 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed6c2745-17b7-4498-ae5e-1cad862c25fe-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:49.341051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.340964 4406 generic.go:356] "Generic (PLEG): container finished" podID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerID="5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06" exitCode=0 Oct 31 07:45:49.341051 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.341012 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" Oct 31 07:45:49.341279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.341050 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" event={"ID":"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0","Type":"ContainerDied","Data":"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06"} Oct 31 07:45:49.341279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.341103 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq" event={"ID":"a36e2b6a-293d-441c-a4b0-11cebaf0ccf0","Type":"ContainerDied","Data":"34e95b277dfedde1653a5a3d2b8d0c9b09bd6c27c6ae9450be728a07157ce4d7"} Oct 31 07:45:49.341279 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.341135 4406 scope.go:122] "RemoveContainer" containerID="5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06" Oct 31 07:45:49.342518 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.342492 4406 generic.go:356] "Generic (PLEG): container finished" podID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerID="cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d" exitCode=0 Oct 31 07:45:49.342645 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.342634 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" Oct 31 07:45:49.342728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.342641 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" event={"ID":"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d","Type":"ContainerDied","Data":"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d"} Oct 31 07:45:49.342728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.342701 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw" event={"ID":"03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d","Type":"ContainerDied","Data":"f09b32d60cfbdca582f094e24e1868a76c4397a9f843ae94c8c16d4ccaee030b"} Oct 31 07:45:49.344222 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.344195 4406 generic.go:356] "Generic (PLEG): container finished" podID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerID="6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc" exitCode=0 Oct 31 07:45:49.344420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.344296 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" event={"ID":"ed6c2745-17b7-4498-ae5e-1cad862c25fe","Type":"ContainerDied","Data":"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc"} Oct 31 07:45:49.344420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.344332 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" event={"ID":"ed6c2745-17b7-4498-ae5e-1cad862c25fe","Type":"ContainerDied","Data":"bce5918b5fc9db926e5b38f6bbe5ada3697c2d0b7cdc858e025fdfc4b1b9d9ef"} Oct 31 07:45:49.344420 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.344418 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf" Oct 31 07:45:49.367425 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.367398 4406 scope.go:122] "RemoveContainer" containerID="5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06" Oct 31 07:45:49.367705 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:49.367686 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06\": container with ID starting with 5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06 not found: ID does not exist" containerID="5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06" Oct 31 07:45:49.367773 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.367709 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06"} err="failed to get container status \"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06\": rpc error: code = NotFound desc = could not find container \"5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06\": container with ID starting with 5970924432dc049d36682247b47efbe2c83fb74b04dceed5d373e944412a4d06 not found: ID does not exist" Oct 31 07:45:49.367773 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.367724 4406 scope.go:122] "RemoveContainer" containerID="cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d" Oct 31 07:45:49.376049 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.376019 4406 scope.go:122] "RemoveContainer" containerID="cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d" Oct 31 07:45:49.376309 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:49.376291 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d\": container with ID starting with cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d not found: ID does not exist" containerID="cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d" Oct 31 07:45:49.376376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.376316 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d"} err="failed to get container status \"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d\": rpc error: code = NotFound desc = could not find container \"cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d\": container with ID starting with cfbf892636e3ef131016f56bb146d38d44dc4d10cc7eb1a058b4993b72c0fd3d not found: ID does not exist" Oct 31 07:45:49.376376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.376331 4406 scope.go:122] "RemoveContainer" containerID="6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc" Oct 31 07:45:49.384069 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.384054 4406 scope.go:122] "RemoveContainer" containerID="6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc" Oct 31 07:45:49.384333 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:49.384311 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc\": container with ID starting with 6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc not found: ID does not exist" containerID="6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc" Oct 31 07:45:49.384456 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.384341 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc"} err="failed to get container status \"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc\": rpc error: code = NotFound desc = could not find container \"6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc\": container with ID starting with 6a3fa677e0e99f9670b09779ed3101d3486973413d37d7630bc6298518016cfc not found: ID does not exist" Oct 31 07:45:49.416350 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.416323 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:45:49.420243 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.420221 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-tj2lw"] Oct 31 07:45:49.450264 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.450220 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:45:49.454276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.454241 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-db7wf"] Oct 31 07:45:49.476555 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.476528 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" path="/var/lib/kubelet/pods/03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d/volumes" Oct 31 07:45:49.477011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.476997 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" path="/var/lib/kubelet/pods/ed6c2745-17b7-4498-ae5e-1cad862c25fe/volumes" Oct 31 07:45:49.484566 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.484547 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:45:49.489922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:49.489900 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-cphrq"] Oct 31 07:45:50.137996 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.137705 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:45:50.211120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.211091 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:45:50.217468 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.217440 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:45:50.237926 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.237892 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.361588 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.361782 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.361834 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.361863 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.361985 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362049 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362090 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362126 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362171 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362231 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362286 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362324 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.362605 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.362358 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.363394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363324 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363394 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363381 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.363506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363435 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.363506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363477 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.363602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363512 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.363602 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363555 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363605 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.363702 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363669 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.363805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363699 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\") pod \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\" (UID: \"a3037fe6-8663-4e40-a96a-b3f2ceadfafc\") " Oct 31 07:45:50.363805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363735 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363805 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363773 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363913 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363804 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363913 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363852 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\") pod \"0b2cb74d-fc64-4682-8d33-4c912e70f766\" (UID: \"0b2cb74d-fc64-4682-8d33-4c912e70f766\") " Oct 31 07:45:50.363913 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363905 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\") pod \"0269e9c8-9c88-4bc9-a581-577653c3984e\" (UID: \"0269e9c8-9c88-4bc9-a581-577653c3984e\") " Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.363010 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.364353 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.364586 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.367479 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.368231 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.369967 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.370147 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.370794 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.372033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.371764 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.374932 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.374905 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.376262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.375551 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:50.377156 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.376437 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.385116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.384641 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.385116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.384839 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.385116 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.384972 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385374 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "kube-api-access-ldb94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385378 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385599 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385633 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385828 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385847 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs" pod "0b2cb74d-fc64-4682-8d33-4c912e70f766" (UID: "0b2cb74d-fc64-4682-8d33-4c912e70f766"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.386014 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.385885 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.387026 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.387940 4406 generic.go:356] "Generic (PLEG): container finished" podID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerID="be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf" exitCode=0 Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388004 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerDied","Data":"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf"} Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388051 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" event={"ID":"0b2cb74d-fc64-4682-8d33-4c912e70f766","Type":"ContainerDied","Data":"ec7ea985b4fc6878e0713da31f8ea7d0991c866f69f1c48bce5e6657301ba016"} Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388081 4406 scope.go:122] "RemoveContainer" containerID="be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf" Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388124 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz" pod "a3037fe6-8663-4e40-a96a-b3f2ceadfafc" (UID: "a3037fe6-8663-4e40-a96a-b3f2ceadfafc"). InnerVolumeSpecName "kube-api-access-tcdmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388184 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48" Oct 31 07:45:50.389322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.388574 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.395396 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.397445 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb" pod "0269e9c8-9c88-4bc9-a581-577653c3984e" (UID: "0269e9c8-9c88-4bc9-a581-577653c3984e"). InnerVolumeSpecName "kube-api-access-jw9rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.397558 4406 generic.go:356] "Generic (PLEG): container finished" podID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerID="94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f" exitCode=0 Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.397739 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.397966 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" event={"ID":"a3037fe6-8663-4e40-a96a-b3f2ceadfafc","Type":"ContainerDied","Data":"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f"} Oct 31 07:45:50.398043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.398007 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv" event={"ID":"a3037fe6-8663-4e40-a96a-b3f2ceadfafc","Type":"ContainerDied","Data":"7e8a148aa9fd89013a500765e48b50dead2aff784085da4c33dd95d27ce44306"} Oct 31 07:45:50.405523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.403903 4406 generic.go:356] "Generic (PLEG): container finished" podID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerID="5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0" exitCode=0 Oct 31 07:45:50.405523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.403984 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" event={"ID":"0269e9c8-9c88-4bc9-a581-577653c3984e","Type":"ContainerDied","Data":"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0"} Oct 31 07:45:50.405523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.404018 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" event={"ID":"0269e9c8-9c88-4bc9-a581-577653c3984e","Type":"ContainerDied","Data":"67b68ac91340df1afb28b9ff9c20748cc7bcce6127ce6734e3acffc0c8fb5650"} Oct 31 07:45:50.405523 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.404079 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6" Oct 31 07:45:50.411629 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.411610 4406 generic.go:356] "Generic (PLEG): container finished" podID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerID="84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2" exitCode=0 Oct 31 07:45:50.411768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.411746 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" event={"ID":"625c5412-1279-4bc1-8741-b8a7745dffd8","Type":"ContainerDied","Data":"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2"} Oct 31 07:45:50.411908 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.411891 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" event={"ID":"625c5412-1279-4bc1-8741-b8a7745dffd8","Type":"ContainerDied","Data":"007b42ac03047f1bb34d34a425b030aeb89923762500ee52770b6169347821e5"} Oct 31 07:45:50.412136 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.412117 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4" Oct 31 07:45:50.412502 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.412489 4406 scope.go:122] "RemoveContainer" containerID="723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb" Oct 31 07:45:50.426026 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.426001 4406 scope.go:122] "RemoveContainer" containerID="be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf" Oct 31 07:45:50.426874 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:50.426848 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf\": container with ID starting with be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf not found: ID does not exist" containerID="be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf" Oct 31 07:45:50.426998 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.426976 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf"} err="failed to get container status \"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf\": rpc error: code = NotFound desc = could not find container \"be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf\": container with ID starting with be95013daa8a0f66736dc40283b3745cd46808be09b88e84a45b53708b70dbbf not found: ID does not exist" Oct 31 07:45:50.427077 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.427000 4406 scope.go:122] "RemoveContainer" containerID="723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb" Oct 31 07:45:50.427411 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:50.427384 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb\": container with ID starting with 723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb not found: ID does not exist" containerID="723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb" Oct 31 07:45:50.427500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.427419 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb"} err="failed to get container status \"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb\": rpc error: code = NotFound desc = could not find container \"723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb\": container with ID starting with 723b417b59a996c076d83c11d3d157d451d867e672efbe0403394ee193f243eb not found: ID does not exist" Oct 31 07:45:50.427500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.427440 4406 scope.go:122] "RemoveContainer" containerID="94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f" Oct 31 07:45:50.440464 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.440442 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:45:50.440865 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.440844 4406 scope.go:122] "RemoveContainer" containerID="94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f" Oct 31 07:45:50.441183 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:50.441157 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f\": container with ID starting with 94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f not found: ID does not exist" containerID="94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f" Oct 31 07:45:50.441308 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.441189 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f"} err="failed to get container status \"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f\": rpc error: code = NotFound desc = could not find container \"94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f\": container with ID starting with 94e765ee67d9932b1e9a48da57402968e764e9a302479ab305519c7cb697487f not found: ID does not exist" Oct 31 07:45:50.441308 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.441206 4406 scope.go:122] "RemoveContainer" containerID="5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0" Oct 31 07:45:50.445968 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.445945 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-qhm48"] Oct 31 07:45:50.450424 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.450400 4406 scope.go:122] "RemoveContainer" containerID="5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0" Oct 31 07:45:50.450753 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:50.450735 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0\": container with ID starting with 5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0 not found: ID does not exist" containerID="5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0" Oct 31 07:45:50.450809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.450761 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0"} err="failed to get container status \"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0\": rpc error: code = NotFound desc = could not find container \"5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0\": container with ID starting with 5b19aa63f60dedb062db9287a00c403fffd0c3c2613fc79621023449935e15d0 not found: ID does not exist" Oct 31 07:45:50.450809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.450779 4406 scope.go:122] "RemoveContainer" containerID="84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2" Oct 31 07:45:50.459095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.459080 4406 scope.go:122] "RemoveContainer" containerID="84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2" Oct 31 07:45:50.459410 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:50.459390 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2\": container with ID starting with 84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2 not found: ID does not exist" containerID="84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2" Oct 31 07:45:50.459486 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.459416 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2"} err="failed to get container status \"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2\": rpc error: code = NotFound desc = could not find container \"84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2\": container with ID starting with 84258d16a40f60304bfc231425944f26a57cc00a008e6d5db40a851a1c6eeab2 not found: ID does not exist" Oct 31 07:45:50.464789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.464770 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.464854 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.464842 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.464907 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.464887 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.464973 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.464958 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465027 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.464989 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465122 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465103 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465149 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.465205 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465164 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465216 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465270 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:50.465327 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465286 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\") pod \"625c5412-1279-4bc1-8741-b8a7745dffd8\" (UID: \"625c5412-1279-4bc1-8741-b8a7745dffd8\") " Oct 31 07:45:50.465469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465449 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.465526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465476 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465631 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465851 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465871 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465886 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465901 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465915 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldb94\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-kube-api-access-ldb94\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465930 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465943 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465957 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465969 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.465982 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466013 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466028 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466041 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466054 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466065 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466078 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466090 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466104 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466117 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcdmz\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-kube-api-access-tcdmz\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466131 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269e9c8-9c88-4bc9-a581-577653c3984e-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466144 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466157 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466170 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2cb74d-fc64-4682-8d33-4c912e70f766-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466184 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0269e9c8-9c88-4bc9-a581-577653c3984e-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466198 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625c5412-1279-4bc1-8741-b8a7745dffd8-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466211 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466227 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw9rb\" (UniqueName: \"kubernetes.io/projected/0269e9c8-9c88-4bc9-a581-577653c3984e-kube-api-access-jw9rb\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466241 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3037fe6-8663-4e40-a96a-b3f2ceadfafc-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466269 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466282 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466295 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.466342 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.466309 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2cb74d-fc64-4682-8d33-4c912e70f766-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.467900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.467220 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:45:50.467900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.467344 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.467900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.467370 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:45:50.467900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.467753 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn" pod "625c5412-1279-4bc1-8741-b8a7745dffd8" (UID: "625c5412-1279-4bc1-8741-b8a7745dffd8"). InnerVolumeSpecName "kube-api-access-99dkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:50.493905 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.493880 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:45:50.497542 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.497523 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-nsxg6"] Oct 31 07:45:50.622337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.622103 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:45:50.654644 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.654602 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-w8ppv"] Oct 31 07:45:50.668930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.668841 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.668930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.668873 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dkn\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-kube-api-access-99dkn\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.668930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.668891 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.668930 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.668904 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625c5412-1279-4bc1-8741-b8a7745dffd8-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:50.764931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.764903 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:45:50.771526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:50.771497 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-mz8l4"] Oct 31 07:45:51.477961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:51.477925 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" path="/var/lib/kubelet/pods/0269e9c8-9c88-4bc9-a581-577653c3984e/volumes" Oct 31 07:45:51.478445 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:51.478430 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" path="/var/lib/kubelet/pods/0b2cb74d-fc64-4682-8d33-4c912e70f766/volumes" Oct 31 07:45:51.478854 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:51.478834 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" path="/var/lib/kubelet/pods/625c5412-1279-4bc1-8741-b8a7745dffd8/volumes" Oct 31 07:45:51.479615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:51.479599 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" path="/var/lib/kubelet/pods/a3037fe6-8663-4e40-a96a-b3f2ceadfafc/volumes" Oct 31 07:45:51.480011 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:51.479998 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" path="/var/lib/kubelet/pods/a36e2b6a-293d-441c-a4b0-11cebaf0ccf0/volumes" Oct 31 07:45:56.409660 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:56.409622 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:45:56.410128 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:56.409862 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" podUID="834dcb5d-ac7f-4072-9088-7f1e87b91869" containerName="maas-api" containerID="cri-o://3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0" gracePeriod=30 Oct 31 07:45:57.056830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.056802 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:45:57.187562 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.187522 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\") pod \"834dcb5d-ac7f-4072-9088-7f1e87b91869\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " Oct 31 07:45:57.187783 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.187657 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\" (UniqueName: \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\") pod \"834dcb5d-ac7f-4072-9088-7f1e87b91869\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " Oct 31 07:45:57.187783 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.187707 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\") pod \"834dcb5d-ac7f-4072-9088-7f1e87b91869\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " Oct 31 07:45:57.187783 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.187733 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\") pod \"834dcb5d-ac7f-4072-9088-7f1e87b91869\" (UID: \"834dcb5d-ac7f-4072-9088-7f1e87b91869\") " Oct 31 07:45:57.188203 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.188157 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca" pod "834dcb5d-ac7f-4072-9088-7f1e87b91869" (UID: "834dcb5d-ac7f-4072-9088-7f1e87b91869"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:45:57.189929 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.189906 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs" pod "834dcb5d-ac7f-4072-9088-7f1e87b91869" (UID: "834dcb5d-ac7f-4072-9088-7f1e87b91869"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:57.190224 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.190206 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls" pod "834dcb5d-ac7f-4072-9088-7f1e87b91869" (UID: "834dcb5d-ac7f-4072-9088-7f1e87b91869"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:45:57.190380 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.190281 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw" pod "834dcb5d-ac7f-4072-9088-7f1e87b91869" (UID: "834dcb5d-ac7f-4072-9088-7f1e87b91869"). InnerVolumeSpecName "kube-api-access-lblsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:45:57.292634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.292240 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:57.292634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.292301 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lblsw\" (UniqueName: \"kubernetes.io/projected/834dcb5d-ac7f-4072-9088-7f1e87b91869-kube-api-access-lblsw\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:57.292634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.292319 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/834dcb5d-ac7f-4072-9088-7f1e87b91869-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:57.292634 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.292332 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/834dcb5d-ac7f-4072-9088-7f1e87b91869-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:45:57.471945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.471908 4406 generic.go:356] "Generic (PLEG): container finished" podID="834dcb5d-ac7f-4072-9088-7f1e87b91869" containerID="3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0" exitCode=0 Oct 31 07:45:57.472406 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.472017 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" Oct 31 07:45:57.482809 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.482782 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" event={"ID":"834dcb5d-ac7f-4072-9088-7f1e87b91869","Type":"ContainerDied","Data":"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0"} Oct 31 07:45:57.482992 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.482976 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr" event={"ID":"834dcb5d-ac7f-4072-9088-7f1e87b91869","Type":"ContainerDied","Data":"655402a2e19fb99ffc2f822919c88ad9d5382c965f2e5fc90f52d309b29097c6"} Oct 31 07:45:57.483107 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.483088 4406 scope.go:122] "RemoveContainer" containerID="3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0" Oct 31 07:45:57.492849 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.492829 4406 scope.go:122] "RemoveContainer" containerID="3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0" Oct 31 07:45:57.493104 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:45:57.493086 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0\": container with ID starting with 3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0 not found: ID does not exist" containerID="3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0" Oct 31 07:45:57.493155 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.493111 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0"} err="failed to get container status \"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0\": rpc error: code = NotFound desc = could not find container \"3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0\": container with ID starting with 3fec004a40adf23c55b78afe7e5fbc546737ec83f3d549e63a0fa9494f3e8cb0 not found: ID does not exist" Oct 31 07:45:57.540229 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.540193 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:45:57.563066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:57.562990 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr"] Oct 31 07:45:59.477006 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:45:59.476970 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="834dcb5d-ac7f-4072-9088-7f1e87b91869" path="/var/lib/kubelet/pods/834dcb5d-ac7f-4072-9088-7f1e87b91869/volumes" Oct 31 07:46:07.792422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:07.792373 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:46:09.992367 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:09.992328 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:46:13.567390 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:13.567359 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:46:14.797725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.797689 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:46:14.798226 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.797963 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" containerID="cri-o://ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e" gracePeriod=30 Oct 31 07:46:14.806994 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.806960 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:46:14.807220 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.807186 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" containerID="cri-o://a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade" gracePeriod=30 Oct 31 07:46:14.819138 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.819104 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:46:14.819456 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.819414 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" containerID="cri-o://3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e" gracePeriod=30 Oct 31 07:46:14.821771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.821744 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:46:14.821956 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:14.821934 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" containerID="cri-o://1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725" gracePeriod=30 Oct 31 07:46:18.568473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:18.568430 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" containerID="cri-o://95c2bac7b50f6463243794ba67759dfac0245b45383b76fc97ba03646d816d5c" gracePeriod=25 Oct 31 07:46:20.103597 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.102722 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:46:20.178240 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.178212 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:46:20.187979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.187955 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:46:20.194480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.194457 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:46:20.208860 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.208837 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.208958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.208872 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.208958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.208920 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.209082 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209063 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209162 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209120 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.209282 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209266 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:20.209503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209478 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209517 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209576 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209625 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209612 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.209806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209642 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209678 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.209806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209714 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.209806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209755 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.209806 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209786 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.210073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209821 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.210073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209866 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.210073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209916 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.210073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.209955 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\") pod \"563b40b1-4f56-49cb-a221-c29026e9fbed\" (UID: \"563b40b1-4f56-49cb-a221-c29026e9fbed\") " Oct 31 07:46:20.210073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210003 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\") pod \"388ef355-43a5-4c5a-aad8-dee28b02d32f\" (UID: \"388ef355-43a5-4c5a-aad8-dee28b02d32f\") " Oct 31 07:46:20.210614 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210585 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.210695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210638 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.210695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210637 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.210695 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210660 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/563b40b1-4f56-49cb-a221-c29026e9fbed-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.210872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210784 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.210872 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210829 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.210982 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.210972 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.211183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.211161 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.211527 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.211361 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.211764 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.211688 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:20.211876 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.211792 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:20.211941 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.211887 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "kube-api-access-r5bpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.212919 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.212890 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.213207 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.213185 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.213503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.213482 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token" pod "388ef355-43a5-4c5a-aad8-dee28b02d32f" (UID: "388ef355-43a5-4c5a-aad8-dee28b02d32f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.213719 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.213694 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.214297 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.214272 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "kube-api-access-s4vgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.214477 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.214457 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo" pod "563b40b1-4f56-49cb-a221-c29026e9fbed" (UID: "563b40b1-4f56-49cb-a221-c29026e9fbed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:20.311804 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311773 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.311984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311812 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.311984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311887 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.311984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311908 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.311984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311927 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.311984 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311957 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.311995 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312061 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312105 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312149 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312198 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312310 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312231 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312317 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312346 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312394 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312426 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\") pod \"3a15c77a-477e-40ec-8038-464f5e4d5e60\" (UID: \"3a15c77a-477e-40ec-8038-464f5e4d5e60\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312463 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.312559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312487 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\") pod \"2b09831b-6f19-4986-b09d-3d88e2fa185d\" (UID: \"2b09831b-6f19-4986-b09d-3d88e2fa185d\") " Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312143 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312168 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312397 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312433 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312597 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.312740 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313352 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313362 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313506 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313511 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313577 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313594 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313608 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313622 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313636 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388ef355-43a5-4c5a-aad8-dee28b02d32f-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313650 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4vgg\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-kube-api-access-s4vgg\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313664 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313667 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313710 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313727 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313742 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313758 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313773 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313787 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/563b40b1-4f56-49cb-a221-c29026e9fbed-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313801 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313814 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313828 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313841 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313854 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a15c77a-477e-40ec-8038-464f5e4d5e60-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313867 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/563b40b1-4f56-49cb-a221-c29026e9fbed-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313881 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388ef355-43a5-4c5a-aad8-dee28b02d32f-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313894 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313906 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.313962 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.313920 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5bpx\" (UniqueName: \"kubernetes.io/projected/388ef355-43a5-4c5a-aad8-dee28b02d32f-kube-api-access-r5bpx\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.315740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.314613 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:20.315740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.315043 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.315740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.315212 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.315740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.315412 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.315740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.315541 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "kube-api-access-96mfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.315940 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.315822 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "kube-api-access-v6nd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:20.316518 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.316496 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo" pod "3a15c77a-477e-40ec-8038-464f5e4d5e60" (UID: "3a15c77a-477e-40ec-8038-464f5e4d5e60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:20.316854 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.316836 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy" pod "2b09831b-6f19-4986-b09d-3d88e2fa185d" (UID: "2b09831b-6f19-4986-b09d-3d88e2fa185d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:20.415478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415448 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415474 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415478 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415485 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415494 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415504 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415518 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6nd2\" (UniqueName: \"kubernetes.io/projected/2b09831b-6f19-4986-b09d-3d88e2fa185d-kube-api-access-v6nd2\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415527 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96mfm\" (UniqueName: \"kubernetes.io/projected/3a15c77a-477e-40ec-8038-464f5e4d5e60-kube-api-access-96mfm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415535 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a15c77a-477e-40ec-8038-464f5e4d5e60-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415545 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b09831b-6f19-4986-b09d-3d88e2fa185d-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.415698 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.415553 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b09831b-6f19-4986-b09d-3d88e2fa185d-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:20.608267 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.608220 4406 generic.go:356] "Generic (PLEG): container finished" podID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerID="1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725" exitCode=0 Oct 31 07:46:20.608433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.608285 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" Oct 31 07:46:20.608433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.608299 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" event={"ID":"388ef355-43a5-4c5a-aad8-dee28b02d32f","Type":"ContainerDied","Data":"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725"} Oct 31 07:46:20.608433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.608350 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth" event={"ID":"388ef355-43a5-4c5a-aad8-dee28b02d32f","Type":"ContainerDied","Data":"12329385621c442de94e49436326cef68d9eff82f68417ad374230883c7b9cfc"} Oct 31 07:46:20.608433 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.608372 4406 scope.go:122] "RemoveContainer" containerID="1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725" Oct 31 07:46:20.610012 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.609990 4406 generic.go:356] "Generic (PLEG): container finished" podID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerID="a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade" exitCode=0 Oct 31 07:46:20.610126 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.610035 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" Oct 31 07:46:20.610126 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.610057 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" event={"ID":"563b40b1-4f56-49cb-a221-c29026e9fbed","Type":"ContainerDied","Data":"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade"} Oct 31 07:46:20.610126 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.610103 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v" event={"ID":"563b40b1-4f56-49cb-a221-c29026e9fbed","Type":"ContainerDied","Data":"75e0d3bd0af61b0233dba3cf37804a5db5b13f1253cfa89e15bd281e88fa43f4"} Oct 31 07:46:20.619921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.619902 4406 scope.go:122] "RemoveContainer" containerID="1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725" Oct 31 07:46:20.620006 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.619970 4406 generic.go:356] "Generic (PLEG): container finished" podID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerID="3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e" exitCode=0 Oct 31 07:46:20.620075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.619996 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" event={"ID":"3a15c77a-477e-40ec-8038-464f5e4d5e60","Type":"ContainerDied","Data":"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e"} Oct 31 07:46:20.620075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.620019 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" Oct 31 07:46:20.620075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.620056 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s" event={"ID":"3a15c77a-477e-40ec-8038-464f5e4d5e60","Type":"ContainerDied","Data":"d6ee444e0b45b4eec36549e8c345937616bfd1ffd9ad36ec7655ef1118fd36e0"} Oct 31 07:46:20.620434 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:20.620408 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725\": container with ID starting with 1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725 not found: ID does not exist" containerID="1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725" Oct 31 07:46:20.620580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.620444 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725"} err="failed to get container status \"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725\": rpc error: code = NotFound desc = could not find container \"1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725\": container with ID starting with 1ff059b3c36da0aa13d1c4f36579874e44bb5efa0cd23a748c69353fd69fa725 not found: ID does not exist" Oct 31 07:46:20.620580 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.620467 4406 scope.go:122] "RemoveContainer" containerID="a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade" Oct 31 07:46:20.621813 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.621793 4406 generic.go:356] "Generic (PLEG): container finished" podID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerID="ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e" exitCode=0 Oct 31 07:46:20.621885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.621867 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" event={"ID":"2b09831b-6f19-4986-b09d-3d88e2fa185d","Type":"ContainerDied","Data":"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e"} Oct 31 07:46:20.621921 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.621914 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" event={"ID":"2b09831b-6f19-4986-b09d-3d88e2fa185d","Type":"ContainerDied","Data":"579cd53a7ab5e51f72b6407a5c2709ecad50309278a8a5e7f0ab4d32852df930"} Oct 31 07:46:20.621997 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.621979 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm" Oct 31 07:46:20.630183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.630168 4406 scope.go:122] "RemoveContainer" containerID="a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade" Oct 31 07:46:20.630865 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:20.630845 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade\": container with ID starting with a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade not found: ID does not exist" containerID="a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade" Oct 31 07:46:20.630958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.630871 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade"} err="failed to get container status \"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade\": rpc error: code = NotFound desc = could not find container \"a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade\": container with ID starting with a2d7a0184ca5b072ea0a242ea3e932b30bb0a0022207af98efb1b9db34b7fade not found: ID does not exist" Oct 31 07:46:20.630958 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.630893 4406 scope.go:122] "RemoveContainer" containerID="3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e" Oct 31 07:46:20.640652 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.640634 4406 scope.go:122] "RemoveContainer" containerID="3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e" Oct 31 07:46:20.640932 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:20.640909 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e\": container with ID starting with 3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e not found: ID does not exist" containerID="3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e" Oct 31 07:46:20.641000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.640943 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e"} err="failed to get container status \"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e\": rpc error: code = NotFound desc = could not find container \"3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e\": container with ID starting with 3c67aaaa035090d72ab6abeef3ead41336497b4d67b754e64b8bd1de39e38a2e not found: ID does not exist" Oct 31 07:46:20.641000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.640966 4406 scope.go:122] "RemoveContainer" containerID="ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e" Oct 31 07:46:20.649674 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.649653 4406 scope.go:122] "RemoveContainer" containerID="ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e" Oct 31 07:46:20.649945 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:20.649915 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e\": container with ID starting with ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e not found: ID does not exist" containerID="ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e" Oct 31 07:46:20.649945 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.649940 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e"} err="failed to get container status \"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e\": rpc error: code = NotFound desc = could not find container \"ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e\": container with ID starting with ed2986dfdbed85011f92b840d0b1a2e717b1dfc075befc3faf804a99eeef3e8e not found: ID does not exist" Oct 31 07:46:20.668615 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.668550 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:46:20.688078 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.688055 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-dfbth"] Oct 31 07:46:20.747124 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.747093 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:46:20.750799 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.750773 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-rb66v"] Oct 31 07:46:20.781835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.781804 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:46:20.785150 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.785127 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-vvc6s"] Oct 31 07:46:20.816030 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.816002 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:46:20.818893 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:20.818868 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8qjm"] Oct 31 07:46:21.477066 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:21.477032 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" path="/var/lib/kubelet/pods/2b09831b-6f19-4986-b09d-3d88e2fa185d/volumes" Oct 31 07:46:21.477565 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:21.477521 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" path="/var/lib/kubelet/pods/388ef355-43a5-4c5a-aad8-dee28b02d32f/volumes" Oct 31 07:46:21.477952 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:21.477937 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" path="/var/lib/kubelet/pods/3a15c77a-477e-40ec-8038-464f5e4d5e60/volumes" Oct 31 07:46:21.478703 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:21.478687 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" path="/var/lib/kubelet/pods/563b40b1-4f56-49cb-a221-c29026e9fbed/volumes" Oct 31 07:46:22.897931 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:22.897894 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" containerID="cri-o://41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f" gracePeriod=45 Oct 31 07:46:23.161168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.161114 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:46:23.249788 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.249754 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.249943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.249821 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.249943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.249851 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.249943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.249907 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\" (UniqueName: \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.250123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.249944 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\" (UniqueName: \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.250123 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250025 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\") pod \"8774b283-bb04-4886-bf3d-9562afca3d91\" (UID: \"8774b283-bb04-4886-bf3d-9562afca3d91\") " Oct 31 07:46:23.250224 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250154 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:23.250224 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250171 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:23.250438 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250416 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:23.250538 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250524 4406 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-home\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.250603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250545 4406 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-tmp-dir\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.250603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.250560 4406 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-model-cache\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.252232 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.252205 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:46:23.252593 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.252573 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "kube-api-access-k7jlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:23.253368 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.253345 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm" pod "8774b283-bb04-4886-bf3d-9562afca3d91" (UID: "8774b283-bb04-4886-bf3d-9562afca3d91"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:23.351372 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.351336 4406 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8774b283-bb04-4886-bf3d-9562afca3d91-dshm\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.351372 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.351369 4406 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8774b283-bb04-4886-bf3d-9562afca3d91-tls-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.351572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.351383 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7jlr\" (UniqueName: \"kubernetes.io/projected/8774b283-bb04-4886-bf3d-9562afca3d91-kube-api-access-k7jlr\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:23.652813 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.652772 4406 generic.go:356] "Generic (PLEG): container finished" podID="8774b283-bb04-4886-bf3d-9562afca3d91" containerID="41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f" exitCode=0 Oct 31 07:46:23.653008 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.652831 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" Oct 31 07:46:23.653008 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.652858 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" event={"ID":"8774b283-bb04-4886-bf3d-9562afca3d91","Type":"ContainerDied","Data":"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f"} Oct 31 07:46:23.653008 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.652899 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t" event={"ID":"8774b283-bb04-4886-bf3d-9562afca3d91","Type":"ContainerDied","Data":"569d67f6be16c5fa9318d9d584f0b94c007166ab2afe609f28f3566995040463"} Oct 31 07:46:23.653008 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.652916 4406 scope.go:122] "RemoveContainer" containerID="41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f" Oct 31 07:46:23.662454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.662433 4406 scope.go:122] "RemoveContainer" containerID="41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f" Oct 31 07:46:23.662742 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:23.662720 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f\": container with ID starting with 41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f not found: ID does not exist" containerID="41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f" Oct 31 07:46:23.662797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.662751 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f"} err="failed to get container status \"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f\": rpc error: code = NotFound desc = could not find container \"41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f\": container with ID starting with 41f4d2284c5974d31903857c1cc5ffbb0365a791cfb8c2b8379308ce2322826f not found: ID does not exist" Oct 31 07:46:23.697910 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.697884 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:46:23.708480 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:23.708455 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-w2-b4e8fd-kserve-8b5794858-8c48t"] Oct 31 07:46:25.478023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:25.477990 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" path="/var/lib/kubelet/pods/8774b283-bb04-4886-bf3d-9562afca3d91/volumes" Oct 31 07:46:27.252819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:27.252778 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 31 07:46:29.804668 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:29.804634 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:46:29.805138 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:29.804835 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" podUID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" containerName="maas-api" containerID="cri-o://4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3" gracePeriod=30 Oct 31 07:46:31.065409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.065385 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:46:31.167337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167238 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\") pod \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " Oct 31 07:46:31.167337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167317 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\") pod \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " Oct 31 07:46:31.167592 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167346 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\") pod \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " Oct 31 07:46:31.167592 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167390 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\" (UniqueName: \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\") pod \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\" (UID: \"34da9ae7-38cb-42f8-8d6e-8719e42340f6\") " Oct 31 07:46:31.167705 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167643 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca" pod "34da9ae7-38cb-42f8-8d6e-8719e42340f6" (UID: "34da9ae7-38cb-42f8-8d6e-8719e42340f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:31.167808 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.167786 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34da9ae7-38cb-42f8-8d6e-8719e42340f6-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:31.169488 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.169459 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls" pod "34da9ae7-38cb-42f8-8d6e-8719e42340f6" (UID: "34da9ae7-38cb-42f8-8d6e-8719e42340f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:46:31.169620 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.169510 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw" pod "34da9ae7-38cb-42f8-8d6e-8719e42340f6" (UID: "34da9ae7-38cb-42f8-8d6e-8719e42340f6"). InnerVolumeSpecName "kube-api-access-f9sgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:31.169721 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.169703 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs" pod "34da9ae7-38cb-42f8-8d6e-8719e42340f6" (UID: "34da9ae7-38cb-42f8-8d6e-8719e42340f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:46:31.268594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.268563 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:31.268594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.268590 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34da9ae7-38cb-42f8-8d6e-8719e42340f6-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:31.268594 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.268599 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9sgw\" (UniqueName: \"kubernetes.io/projected/34da9ae7-38cb-42f8-8d6e-8719e42340f6-kube-api-access-f9sgw\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:31.699534 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.699501 4406 generic.go:356] "Generic (PLEG): container finished" podID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" containerID="4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3" exitCode=0 Oct 31 07:46:31.699696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.699548 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" Oct 31 07:46:31.699696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.699571 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" event={"ID":"34da9ae7-38cb-42f8-8d6e-8719e42340f6","Type":"ContainerDied","Data":"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3"} Oct 31 07:46:31.699696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.699613 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm" event={"ID":"34da9ae7-38cb-42f8-8d6e-8719e42340f6","Type":"ContainerDied","Data":"6ea327053d11c7acc6427a0cfa7cefe215fb414967d5c6220f100f9271082c6f"} Oct 31 07:46:31.699696 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.699633 4406 scope.go:122] "RemoveContainer" containerID="4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3" Oct 31 07:46:31.710458 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.710432 4406 scope.go:122] "RemoveContainer" containerID="4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3" Oct 31 07:46:31.710760 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:31.710739 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3\": container with ID starting with 4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3 not found: ID does not exist" containerID="4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3" Oct 31 07:46:31.710853 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.710772 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3"} err="failed to get container status \"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3\": rpc error: code = NotFound desc = could not find container \"4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3\": container with ID starting with 4a830a0e3891592f2dc6e5789239da4f55bd681f776f978e538f9a5ef2cfe0a3 not found: ID does not exist" Oct 31 07:46:31.746617 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.746538 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:46:31.757202 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:31.757175 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm"] Oct 31 07:46:33.476028 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:33.475996 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" path="/var/lib/kubelet/pods/34da9ae7-38cb-42f8-8d6e-8719e42340f6/volumes" Oct 31 07:46:36.978814 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.978756 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:46:36.979430 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.979024 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" containerID="cri-o://03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0" gracePeriod=30 Oct 31 07:46:36.989300 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.989049 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:46:36.989300 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.989281 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" containerID="cri-o://a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200" gracePeriod=30 Oct 31 07:46:36.992013 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.991985 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:46:36.992202 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:36.992179 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" containerID="cri-o://e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8" gracePeriod=30 Oct 31 07:46:37.214132 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:37.214096 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:46:37.214315 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:37.214161 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:46:37.252023 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:37.251954 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 31 07:46:38.752714 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.752681 4406 generic.go:356] "Generic (PLEG): container finished" podID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerID="95c2bac7b50f6463243794ba67759dfac0245b45383b76fc97ba03646d816d5c" exitCode=0 Oct 31 07:46:38.753079 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.752760 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" event={"ID":"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05","Type":"ContainerDied","Data":"95c2bac7b50f6463243794ba67759dfac0245b45383b76fc97ba03646d816d5c"} Oct 31 07:46:38.833423 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.833397 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:46:38.962603 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.962566 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\") pod \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " Oct 31 07:46:38.962794 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.962630 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\" (UniqueName: \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\") pod \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\" (UID: \"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05\") " Oct 31 07:46:38.962978 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.962955 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume" pod "7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" (UID: "7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:38.964699 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:38.964679 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8" pod "7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" (UID: "7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05"). InnerVolumeSpecName "kube-api-access-7sbz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:39.063656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.063617 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sbz8\" (UniqueName: \"kubernetes.io/projected/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-kube-api-access-7sbz8\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:39.063656 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.063648 4406 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05-plugins-config-volume\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:39.758559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.758474 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" event={"ID":"7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05","Type":"ContainerDied","Data":"bf4ab8d79df0989b17335760bc45f4c311208b088741152c4f97ee40075d3029"} Oct 31 07:46:39.758559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.758498 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww" Oct 31 07:46:39.758559 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.758536 4406 scope.go:122] "RemoveContainer" containerID="95c2bac7b50f6463243794ba67759dfac0245b45383b76fc97ba03646d816d5c" Oct 31 07:46:39.804655 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.804626 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:46:39.814769 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:39.814747 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b4e8fd-987fc9659-5mnww"] Oct 31 07:46:39.992707 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:39.992671 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:46:40.994914 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:40.994877 4406 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:46:40.995378 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:40.994940 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:46:41.477850 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:41.477813 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" path="/var/lib/kubelet/pods/7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05/volumes" Oct 31 07:46:41.707000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:41.706965 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:46:41.707210 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:41.707182 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" podUID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" containerName="manager" containerID="cri-o://3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587" gracePeriod=30 Oct 31 07:46:42.265963 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.261987 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:46:42.323870 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.323841 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\") pod \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " Oct 31 07:46:42.324092 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.324073 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\") pod \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " Oct 31 07:46:42.324320 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.324297 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\" (UniqueName: \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\") pod \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\" (UID: \"03b47e62-60ad-4f54-8b5b-654e9c0f7865\") " Oct 31 07:46:42.331740 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.331473 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:46:42.354830 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.354791 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t" pod "03b47e62-60ad-4f54-8b5b-654e9c0f7865" (UID: "03b47e62-60ad-4f54-8b5b-654e9c0f7865"). InnerVolumeSpecName "kube-api-access-x9d9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.402147 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.401820 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs" pod "03b47e62-60ad-4f54-8b5b-654e9c0f7865" (UID: "03b47e62-60ad-4f54-8b5b-654e9c0f7865"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:46:42.408834 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.408560 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:46:42.409445 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.409418 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert" pod "03b47e62-60ad-4f54-8b5b-654e9c0f7865" (UID: "03b47e62-60ad-4f54-8b5b-654e9c0f7865"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:46:42.426021 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.425979 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.426385 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.426363 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.426593 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.426574 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.426780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.426755 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.426933 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.426915 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.427060 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.427044 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.427170 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.427155 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.427311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.427294 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.427439 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.427422 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.429901 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.429881 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.430304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.430287 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.428408 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.428687 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.428911 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.429201 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.429767 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.429815 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.430991 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.430201 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.431885 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.431821 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.432125 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.430876 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.432831 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.432291 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.433012 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.432995 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.433199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.433183 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\") pod \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\" (UID: \"96281577-b4a6-4cd2-b6ce-f6b1d10d1204\") " Oct 31 07:46:42.433359 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.433342 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.433516 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.433500 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.433672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.433656 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\") pod \"8562a3bf-ed14-4f79-8620-df185cb09a96\" (UID: \"8562a3bf-ed14-4f79-8620-df185cb09a96\") " Oct 31 07:46:42.434280 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434243 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.434411 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434396 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.434538 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434525 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8562a3bf-ed14-4f79-8620-df185cb09a96-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.434654 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434641 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.434771 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434755 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9d9t\" (UniqueName: \"kubernetes.io/projected/03b47e62-60ad-4f54-8b5b-654e9c0f7865-kube-api-access-x9d9t\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.434887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.434874 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435024 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435011 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435151 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435136 4406 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-webhook-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435327 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435455 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435443 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435573 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435560 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b47e62-60ad-4f54-8b5b-654e9c0f7865-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.435986 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.435967 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.440808 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.439517 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.453943 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.453899 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.465978 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.465932 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:42.490601 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.490342 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:46:42.494061 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.494009 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "kube-api-access-qprrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.508899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.508853 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.508899 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.508888 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.509337 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.509303 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "kube-api-access-pxx69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.512537 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.512500 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo" pod "96281577-b4a6-4cd2-b6ce-f6b1d10d1204" (UID: "96281577-b4a6-4cd2-b6ce-f6b1d10d1204"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:42.512747 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.512711 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token" pod "8562a3bf-ed14-4f79-8620-df185cb09a96" (UID: "8562a3bf-ed14-4f79-8620-df185cb09a96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551557 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551637 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551687 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551722 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551754 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551817 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551896 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551968 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.551997 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\") pod \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\" (UID: \"0e6c54a2-9f4f-4a94-924b-fecc579f24f1\") " Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552372 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qprrx\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-kube-api-access-qprrx\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552397 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxx69\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-kube-api-access-pxx69\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552413 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552428 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552445 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552458 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552471 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96281577-b4a6-4cd2-b6ce-f6b1d10d1204-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552486 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552500 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.560324 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.552514 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8562a3bf-ed14-4f79-8620-df185cb09a96-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.571768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.571374 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "kube-api-access-vs652". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.571768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.571604 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.572190 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.572011 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.572529 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.572340 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.573538 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.572758 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:46:42.574309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.574272 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.576581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.576546 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:46:42.583975 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.583929 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:46:42.586384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.586350 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo" pod "0e6c54a2-9f4f-4a94-924b-fecc579f24f1" (UID: "0e6c54a2-9f4f-4a94-924b-fecc579f24f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656233 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656312 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656329 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656343 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656357 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs652\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-kube-api-access-vs652\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656372 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656386 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656401 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.656440 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.656414 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6c54a2-9f4f-4a94-924b-fecc579f24f1-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:46:42.778685 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.778642 4406 generic.go:356] "Generic (PLEG): container finished" podID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerID="a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200" exitCode=0 Oct 31 07:46:42.778856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.778710 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" Oct 31 07:46:42.778856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.778770 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" event={"ID":"0e6c54a2-9f4f-4a94-924b-fecc579f24f1","Type":"ContainerDied","Data":"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200"} Oct 31 07:46:42.778856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.778823 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f" event={"ID":"0e6c54a2-9f4f-4a94-924b-fecc579f24f1","Type":"ContainerDied","Data":"e7d663bdbd8afa1f8c382af1b14d9d1c3702a0a6211c39d490a3242b0a646da5"} Oct 31 07:46:42.778856 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.778855 4406 scope.go:122] "RemoveContainer" containerID="a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200" Oct 31 07:46:42.780954 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.780929 4406 generic.go:356] "Generic (PLEG): container finished" podID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" containerID="3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587" exitCode=0 Oct 31 07:46:42.781057 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.781038 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" event={"ID":"03b47e62-60ad-4f54-8b5b-654e9c0f7865","Type":"ContainerDied","Data":"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587"} Oct 31 07:46:42.781125 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.781085 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" event={"ID":"03b47e62-60ad-4f54-8b5b-654e9c0f7865","Type":"ContainerDied","Data":"4a107060a0161dda9c2356cb876061facaa7a9e4a2edd516f33f3143003ab1c4"} Oct 31 07:46:42.781185 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.781159 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-x9cqc" Oct 31 07:46:42.784218 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.784187 4406 generic.go:356] "Generic (PLEG): container finished" podID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerID="e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8" exitCode=0 Oct 31 07:46:42.784356 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.784321 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerDied","Data":"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8"} Oct 31 07:46:42.784429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.784362 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" event={"ID":"8562a3bf-ed14-4f79-8620-df185cb09a96","Type":"ContainerDied","Data":"38975fdc0957ed84d0317242fe77e9674e20d9e2d16a16e6c921759df26e069f"} Oct 31 07:46:42.793556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.787362 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6" Oct 31 07:46:42.793556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.791566 4406 generic.go:356] "Generic (PLEG): container finished" podID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerID="03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0" exitCode=0 Oct 31 07:46:42.793556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.791612 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" event={"ID":"96281577-b4a6-4cd2-b6ce-f6b1d10d1204","Type":"ContainerDied","Data":"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0"} Oct 31 07:46:42.793556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.791652 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" event={"ID":"96281577-b4a6-4cd2-b6ce-f6b1d10d1204","Type":"ContainerDied","Data":"800f466861ec2e51e9646c795399655d6b2923b73286cefbf66f65476a05d49b"} Oct 31 07:46:42.793556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.791734 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98" Oct 31 07:46:42.807076 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.805418 4406 scope.go:122] "RemoveContainer" containerID="a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200" Oct 31 07:46:42.810901 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:42.810717 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200\": container with ID starting with a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200 not found: ID does not exist" containerID="a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200" Oct 31 07:46:42.810901 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.810757 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200"} err="failed to get container status \"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200\": rpc error: code = NotFound desc = could not find container \"a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200\": container with ID starting with a315e3b24a070e48a745942db1cacacd5d2c1955eebe2a5374f3024ab1792200 not found: ID does not exist" Oct 31 07:46:42.810901 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.810782 4406 scope.go:122] "RemoveContainer" containerID="3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587" Oct 31 07:46:42.826942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.826921 4406 scope.go:122] "RemoveContainer" containerID="3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587" Oct 31 07:46:42.827221 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:42.827191 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587\": container with ID starting with 3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587 not found: ID does not exist" containerID="3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587" Oct 31 07:46:42.827329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.827232 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587"} err="failed to get container status \"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587\": rpc error: code = NotFound desc = could not find container \"3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587\": container with ID starting with 3bf50d33f96d4b15c88585f3f80651ce3df98aaf2c8225a70c4997ca3e505587 not found: ID does not exist" Oct 31 07:46:42.827329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.827283 4406 scope.go:122] "RemoveContainer" containerID="e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8" Oct 31 07:46:42.839124 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.839101 4406 scope.go:122] "RemoveContainer" containerID="2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b" Oct 31 07:46:42.851148 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.851126 4406 scope.go:122] "RemoveContainer" containerID="e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8" Oct 31 07:46:42.851522 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:42.851495 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8\": container with ID starting with e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8 not found: ID does not exist" containerID="e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8" Oct 31 07:46:42.851622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.851535 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8"} err="failed to get container status \"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8\": rpc error: code = NotFound desc = could not find container \"e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8\": container with ID starting with e09aa5a5dd07cfe579e94471fbe5a6e2a76d37bb39b842e8ae76fd0238157cd8 not found: ID does not exist" Oct 31 07:46:42.851622 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.851561 4406 scope.go:122] "RemoveContainer" containerID="2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b" Oct 31 07:46:42.851892 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:42.851868 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b\": container with ID starting with 2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b not found: ID does not exist" containerID="2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b" Oct 31 07:46:42.851993 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.851900 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b"} err="failed to get container status \"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b\": rpc error: code = NotFound desc = could not find container \"2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b\": container with ID starting with 2b6566eff20f646bdd19ff9da74fed35bca59296b84836dc962d9fd240f3b29b not found: ID does not exist" Oct 31 07:46:42.851993 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.851921 4406 scope.go:122] "RemoveContainer" containerID="03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0" Oct 31 07:46:42.863096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.863075 4406 scope.go:122] "RemoveContainer" containerID="03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0" Oct 31 07:46:42.863562 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:46:42.863528 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0\": container with ID starting with 03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0 not found: ID does not exist" containerID="03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0" Oct 31 07:46:42.863666 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.863562 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0"} err="failed to get container status \"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0\": rpc error: code = NotFound desc = could not find container \"03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0\": container with ID starting with 03ee51f97527ec4cf193d0f8d70353a126a8ae6417a76be71f912525a7fd38f0 not found: ID does not exist" Oct 31 07:46:42.872647 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.872612 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:46:42.883272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.883218 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-dpxn6"] Oct 31 07:46:42.924274 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.924220 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:46:42.924541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.924520 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-prk9f"] Oct 31 07:46:42.949436 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.947807 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:46:42.951745 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.951706 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-9sn98"] Oct 31 07:46:42.984362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.984334 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:46:42.986495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:42.986470 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-x9cqc"] Oct 31 07:46:43.485491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:43.485455 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" path="/var/lib/kubelet/pods/03b47e62-60ad-4f54-8b5b-654e9c0f7865/volumes" Oct 31 07:46:43.493383 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:43.488003 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" path="/var/lib/kubelet/pods/0e6c54a2-9f4f-4a94-924b-fecc579f24f1/volumes" Oct 31 07:46:43.493383 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:43.488643 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" path="/var/lib/kubelet/pods/8562a3bf-ed14-4f79-8620-df185cb09a96/volumes" Oct 31 07:46:43.494572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:43.494550 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" path="/var/lib/kubelet/pods/96281577-b4a6-4cd2-b6ce-f6b1d10d1204/volumes" Oct 31 07:46:45.337063 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337025 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337413 4406 cpu_manager.go:414] "containerMap: removing container" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337427 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337438 4406 cpu_manager.go:414] "containerMap: removing container" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337443 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337450 4406 cpu_manager.go:414] "containerMap: removing container" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337455 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337463 4406 cpu_manager.go:414] "containerMap: removing container" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337468 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337474 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337478 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337487 4406 cpu_manager.go:414] "containerMap: removing container" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337491 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337499 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:46:45.337491 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337503 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337509 4406 cpu_manager.go:414] "containerMap: removing container" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337514 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337520 4406 cpu_manager.go:414] "containerMap: removing container" podUID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" containerName="manager" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337525 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" containerName="manager" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337534 4406 cpu_manager.go:414] "containerMap: removing container" podUID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337539 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337546 4406 cpu_manager.go:414] "containerMap: removing container" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337550 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337562 4406 cpu_manager.go:414] "containerMap: removing container" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337566 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337574 4406 cpu_manager.go:414] "containerMap: removing container" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337579 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337585 4406 cpu_manager.go:414] "containerMap: removing container" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337589 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337596 4406 cpu_manager.go:414] "containerMap: removing container" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337601 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337608 4406 cpu_manager.go:414] "containerMap: removing container" podUID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337612 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337620 4406 cpu_manager.go:414] "containerMap: removing container" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337625 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337631 4406 cpu_manager.go:414] "containerMap: removing container" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337636 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337643 4406 cpu_manager.go:414] "containerMap: removing container" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337648 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337654 4406 cpu_manager.go:414] "containerMap: removing container" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337658 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337666 4406 cpu_manager.go:414] "containerMap: removing container" podUID="17f81653-6f76-4ad3-9d2e-eaa881bca454" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337670 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17f81653-6f76-4ad3-9d2e-eaa881bca454" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337677 4406 cpu_manager.go:414] "containerMap: removing container" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337681 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337687 4406 cpu_manager.go:414] "containerMap: removing container" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337691 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337696 4406 cpu_manager.go:414] "containerMap: removing container" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337701 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337710 4406 cpu_manager.go:414] "containerMap: removing container" podUID="834dcb5d-ac7f-4072-9088-7f1e87b91869" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337714 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="834dcb5d-ac7f-4072-9088-7f1e87b91869" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337749 4406 cpu_manager.go:414] "containerMap: removing container" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337754 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337762 4406 cpu_manager.go:414] "containerMap: removing container" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337767 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337772 4406 cpu_manager.go:414] "containerMap: removing container" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337777 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337846 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="36a8269e-a81e-413d-b354-adbb5ff46faa" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337859 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e63e3d5-033c-4870-a00f-3fc867b8ae41" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337872 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a50b861-b673-406c-9a55-e27a5261bc29" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337879 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="17f81653-6f76-4ad3-9d2e-eaa881bca454" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337886 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="96281577-b4a6-4cd2-b6ce-f6b1d10d1204" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337891 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="563b40b1-4f56-49cb-a221-c29026e9fbed" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337898 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed6c2745-17b7-4498-ae5e-1cad862c25fe" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337904 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="834dcb5d-ac7f-4072-9088-7f1e87b91869" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337908 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad7ffb31-b09f-4833-b4a3-1ca70838af37" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337912 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="388ef355-43a5-4c5a-aad8-dee28b02d32f" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337917 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1a9ed28-11cb-4b5c-9616-01ddf2136d19" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337924 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c6c9bb5-a5b8-40cf-b1ab-07c7616a0b05" containerName="payload-pre-processing" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337932 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="0269e9c8-9c88-4bc9-a581-577653c3984e" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337940 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e6c54a2-9f4f-4a94-924b-fecc579f24f1" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337947 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="625c5412-1279-4bc1-8741-b8a7745dffd8" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337951 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8774b283-bb04-4886-bf3d-9562afca3d91" containerName="main" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337956 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337962 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337966 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a15c77a-477e-40ec-8038-464f5e4d5e60" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337971 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b47e62-60ad-4f54-8b5b-654e9c0f7865" containerName="manager" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337978 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="34da9ae7-38cb-42f8-8d6e-8719e42340f6" containerName="maas-api" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337988 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3e4deff-f3d9-4a62-b21e-39420747cb23" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337994 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="03fb0bc4-ef07-4dd3-97fb-2f95e69d0a8d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.337999 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b09831b-6f19-4986-b09d-3d88e2fa185d" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.338004 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="a36e2b6a-293d-441c-a4b0-11cebaf0ccf0" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.338013 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3037fe6-8663-4e40-a96a-b3f2ceadfafc" containerName="istio-proxy" Oct 31 07:46:45.338017 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.338021 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c7c760d-efb8-4e34-ac8b-0202884bbcd1" containerName="maas-api" Oct 31 07:46:45.342768 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.342749 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.361566 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.361545 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 07:46:45.369219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.369198 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 07:46:45.369219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.369198 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rrl9j\"" Oct 31 07:46:45.369380 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.369239 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 07:46:45.371033 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.371004 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:46:45.379979 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.379954 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5l7q\" (UniqueName: \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.380093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.380045 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.380167 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.380146 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.481481 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.481450 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5l7q\" (UniqueName: \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.481642 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.481489 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.481642 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.481542 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.484212 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.484185 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.484322 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.484185 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.499697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.499672 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5l7q\" (UniqueName: \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\") pod \"maas-controller-5f6b9497b-fk726\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.656682 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.656594 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:45.949357 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:45.949276 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:46:45.952348 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:46:45.952316 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525a2416_c830_4ccb_9fdc_e7d67399ed65.slice/crio-ef5b2790037728d3071286c8dde595cc8cf52134ff8d02150f617a5716417611 WatchSource:0}: Error finding container ef5b2790037728d3071286c8dde595cc8cf52134ff8d02150f617a5716417611: Status 404 returned error can't find the container with id ef5b2790037728d3071286c8dde595cc8cf52134ff8d02150f617a5716417611 Oct 31 07:46:46.898641 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:46.898230 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-fk726" event={"ID":"525a2416-c830-4ccb-9fdc-e7d67399ed65","Type":"ContainerStarted","Data":"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767"} Oct 31 07:46:46.898641 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:46.898424 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:46:46.898641 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:46.898462 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-fk726" event={"ID":"525a2416-c830-4ccb-9fdc-e7d67399ed65","Type":"ContainerStarted","Data":"ef5b2790037728d3071286c8dde595cc8cf52134ff8d02150f617a5716417611"} Oct 31 07:46:46.935237 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:46.935158 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5f6b9497b-fk726" podStartSLOduration=1.399740219 podStartE2EDuration="1.935140806s" totalImagesPullingTime="535.400587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:46:46.934173843 +0000 UTC m=+1113.581173123" watchObservedRunningTime="2026-10-31 07:46:46.935140806 +0000 UTC m=+1113.582140088" Oct 31 07:46:57.906582 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:46:57.906508 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:47:09.991291 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:47:09.991231 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:47:16.168313 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.168278 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:47:16.168751 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.168562 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-5f6b9497b-fk726" podUID="525a2416-c830-4ccb-9fdc-e7d67399ed65" containerName="manager" containerID="cri-o://041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767" gracePeriod=30 Oct 31 07:47:16.422060 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.421995 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:47:16.582362 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.582333 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\" (UniqueName: \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\") pod \"525a2416-c830-4ccb-9fdc-e7d67399ed65\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " Oct 31 07:47:16.582541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.582402 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\") pod \"525a2416-c830-4ccb-9fdc-e7d67399ed65\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " Oct 31 07:47:16.582541 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.582430 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\") pod \"525a2416-c830-4ccb-9fdc-e7d67399ed65\" (UID: \"525a2416-c830-4ccb-9fdc-e7d67399ed65\") " Oct 31 07:47:16.584443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.584415 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q" pod "525a2416-c830-4ccb-9fdc-e7d67399ed65" (UID: "525a2416-c830-4ccb-9fdc-e7d67399ed65"). InnerVolumeSpecName "kube-api-access-h5l7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:47:16.584443 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.584418 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert" pod "525a2416-c830-4ccb-9fdc-e7d67399ed65" (UID: "525a2416-c830-4ccb-9fdc-e7d67399ed65"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:47:16.584633 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.584500 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs" pod "525a2416-c830-4ccb-9fdc-e7d67399ed65" (UID: "525a2416-c830-4ccb-9fdc-e7d67399ed65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:47:16.683869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.683782 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5l7q\" (UniqueName: \"kubernetes.io/projected/525a2416-c830-4ccb-9fdc-e7d67399ed65-kube-api-access-h5l7q\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:47:16.683869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.683809 4406 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-webhook-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:47:16.683869 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:16.683826 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a2416-c830-4ccb-9fdc-e7d67399ed65-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:47:17.038376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.038290 4406 generic.go:356] "Generic (PLEG): container finished" podID="525a2416-c830-4ccb-9fdc-e7d67399ed65" containerID="041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767" exitCode=0 Oct 31 07:47:17.038376 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.038340 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-fk726" Oct 31 07:47:17.038556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.038372 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-fk726" event={"ID":"525a2416-c830-4ccb-9fdc-e7d67399ed65","Type":"ContainerDied","Data":"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767"} Oct 31 07:47:17.038556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.038431 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-fk726" event={"ID":"525a2416-c830-4ccb-9fdc-e7d67399ed65","Type":"ContainerDied","Data":"ef5b2790037728d3071286c8dde595cc8cf52134ff8d02150f617a5716417611"} Oct 31 07:47:17.038556 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.038460 4406 scope.go:122] "RemoveContainer" containerID="041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767" Oct 31 07:47:17.047835 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.047804 4406 scope.go:122] "RemoveContainer" containerID="041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767" Oct 31 07:47:17.048108 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:47:17.048089 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767\": container with ID starting with 041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767 not found: ID does not exist" containerID="041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767" Oct 31 07:47:17.048158 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.048122 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767"} err="failed to get container status \"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767\": rpc error: code = NotFound desc = could not find container \"041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767\": container with ID starting with 041a4298fed27dddfbdf4dc1f2210b19f8ae95a9a581f08273aa35f236ef6767 not found: ID does not exist" Oct 31 07:47:17.086172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.086140 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:47:17.096677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.096656 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-fk726"] Oct 31 07:47:17.476467 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:17.476434 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="525a2416-c830-4ccb-9fdc-e7d67399ed65" path="/var/lib/kubelet/pods/525a2416-c830-4ccb-9fdc-e7d67399ed65/volumes" Oct 31 07:47:18.240187 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240150 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f6b9497b-5ln9b"] Oct 31 07:47:18.240729 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240702 4406 cpu_manager.go:414] "containerMap: removing container" podUID="525a2416-c830-4ccb-9fdc-e7d67399ed65" containerName="manager" Oct 31 07:47:18.240729 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240725 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="525a2416-c830-4ccb-9fdc-e7d67399ed65" containerName="manager" Oct 31 07:47:18.240892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240743 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:47:18.240892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240748 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:47:18.240892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240812 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="525a2416-c830-4ccb-9fdc-e7d67399ed65" containerName="manager" Oct 31 07:47:18.240892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240822 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b2cb74d-fc64-4682-8d33-4c912e70f766" containerName="istio-proxy" Oct 31 07:47:18.240892 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.240829 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8562a3bf-ed14-4f79-8620-df185cb09a96" containerName="istio-proxy" Oct 31 07:47:18.245035 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.245016 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.262915 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.262888 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 07:47:18.270074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.270049 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rrl9j\"" Oct 31 07:47:18.270074 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.270049 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 07:47:18.270438 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.270420 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 07:47:18.272493 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.272464 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-5ln9b"] Oct 31 07:47:18.398546 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.398513 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-metrics-certs\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.398725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.398556 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfkc\" (UniqueName: \"kubernetes.io/projected/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-kube-api-access-5vfkc\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.398725 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.398646 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-webhook-cert\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.499305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.499222 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-metrics-certs\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.499305 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.499278 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfkc\" (UniqueName: \"kubernetes.io/projected/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-kube-api-access-5vfkc\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.499693 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.499315 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-webhook-cert\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.501716 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.501693 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-webhook-cert\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.501797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.501731 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-metrics-certs\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.517000 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.516969 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfkc\" (UniqueName: \"kubernetes.io/projected/7c787a1a-1f51-4225-a4d8-477c8d7cbf0f-kube-api-access-5vfkc\") pod \"maas-controller-5f6b9497b-5ln9b\" (UID: \"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f\") " pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.557819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.557796 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:18.849970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:18.849936 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f6b9497b-5ln9b"] Oct 31 07:47:18.855352 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:47:18.855324 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c787a1a_1f51_4225_a4d8_477c8d7cbf0f.slice/crio-ebc65d0a7431f168090d64c7f8a43e79f39c3cb765e1c245a4d0c1a86fd8560e WatchSource:0}: Error finding container ebc65d0a7431f168090d64c7f8a43e79f39c3cb765e1c245a4d0c1a86fd8560e: Status 404 returned error can't find the container with id ebc65d0a7431f168090d64c7f8a43e79f39c3cb765e1c245a4d0c1a86fd8560e Oct 31 07:47:19.052390 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:19.051480 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" event={"ID":"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f","Type":"ContainerStarted","Data":"ebc65d0a7431f168090d64c7f8a43e79f39c3cb765e1c245a4d0c1a86fd8560e"} Oct 31 07:47:20.057448 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:20.057406 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" event={"ID":"7c787a1a-1f51-4225-a4d8-477c8d7cbf0f","Type":"ContainerStarted","Data":"2234ad045dbe74a95904a8bd400224ba99bd657a7257f446186d4f9fc5392ad1"} Oct 31 07:47:20.057858 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:20.057541 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:20.096147 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:20.096097 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" podStartSLOduration=1.611253664 podStartE2EDuration="2.09608303s" totalImagesPullingTime="484.829366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:47:20.093879269 +0000 UTC m=+1146.740878547" watchObservedRunningTime="2026-10-31 07:47:20.09608303 +0000 UTC m=+1146.743082310" Oct 31 07:47:31.063195 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:47:31.063165 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f6b9497b-5ln9b" Oct 31 07:47:39.990744 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:47:39.990701 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:48:08.075401 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:48:08.075357 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:48:08.076219 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:48:08.076181 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:48:09.993341 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:48:09.993300 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:48:39.991308 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:48:39.991245 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:49:09.990695 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:49:09.990651 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:49:39.990711 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:49:39.990675 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:50:09.991215 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:50:09.991129 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:50:39.990998 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:50:39.990960 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:50:52.499451 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:50:52.499405 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:50:52.500313 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:50:52.500234 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:50:53.079273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:50:53.078473 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:50:53.079273 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:50:53.078555 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:51:10.129701 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:51:10.129652 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:51:40.006243 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:51:40.006199 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:52:09.991386 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:52:09.991350 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:52:39.005469 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:52:39.005415 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:52:39.006160 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:52:39.006121 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:52:39.074389 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:52:39.074350 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 07:52:39.074668 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:52:39.074637 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 07:52:40.020272 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:52:40.019485 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:53:09.991893 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:53:09.991803 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:53:34.911841 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:34.911789 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:53:34.926790 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:34.926753 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:34.937072 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:34.937045 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:53:34.945749 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:34.945712 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-009b0f-openshift-default-dockercfg-m5fq9\"" Oct 31 07:53:35.064819 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.064781 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065111 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065083 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065343 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065323 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065500 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065480 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065650 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065629 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065762 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065746 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.065989 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.065961 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.066106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.066012 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.066106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.066066 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66xg\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167600 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167514 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167604 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167644 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167671 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167693 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.167775 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167719 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167866 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.167943 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66xg\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168017 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168024 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168073 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168058 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168371 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168222 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168371 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168346 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.168745 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.168721 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.170135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.170116 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.170377 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.170358 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.185669 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.185647 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.185951 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.185929 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66xg\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\") pod \"e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.243887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.243863 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:35.552960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.552780 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:53:35.555662 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:53:35.555635 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2137a68_ed2c_4941_8917_edeab147cafe.slice/crio-983eecd1eb841736565af726adb0e0a52fbe52db887871022b1845f4db81b272 WatchSource:0}: Error finding container 983eecd1eb841736565af726adb0e0a52fbe52db887871022b1845f4db81b272: Status 404 returned error can't find the container with id 983eecd1eb841736565af726adb0e0a52fbe52db887871022b1845f4db81b272 Oct 31 07:53:35.558010 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.557968 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:53:35.558094 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.558056 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:53:35.558148 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:35.558100 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:53:36.171145 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:36.171112 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerStarted","Data":"185f0aaea30c0fafa535da24c7a5c2769ff6f4f5c76f76f3d53759d12696c07e"} Oct 31 07:53:36.171554 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:36.171171 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerStarted","Data":"983eecd1eb841736565af726adb0e0a52fbe52db887871022b1845f4db81b272"} Oct 31 07:53:36.230834 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:36.230782 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podStartSLOduration=2.230768902 podStartE2EDuration="2.230768902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:53:36.219108836 +0000 UTC m=+1522.866108154" watchObservedRunningTime="2026-10-31 07:53:36.230768902 +0000 UTC m=+1522.877768183" Oct 31 07:53:36.244172 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:36.244136 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:36.249844 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:36.249816 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:37.175572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:37.175543 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:37.176460 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:37.176440 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:53:39.991598 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:53:39.991564 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:53:50.013845 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.013813 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:53:50.017471 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.017455 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.041551 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.041520 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-009b0f-serving-cert\"" Oct 31 07:53:50.043558 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.043526 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:53:50.107928 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.107895 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.108106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.107948 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qhc\" (UniqueName: \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.108148 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.108089 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.108188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.108157 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.209384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.209345 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.209557 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.209422 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qhc\" (UniqueName: \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.209557 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.209484 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.209557 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.209538 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.210381 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.210353 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.212797 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.212770 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.212928 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.212795 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.227713 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.227680 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qhc\" (UniqueName: \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\") pod \"maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.333990 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.333955 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:50.634393 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.634309 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:53:50.637801 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:53:50.637776 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0289e4c2_ec1e_4c91_a3af_464962362949.slice/crio-bcb9be87e5003ea600cbc522b1125a7be5e24a2c8ebf11c1bedbd761d783b93b WatchSource:0}: Error finding container bcb9be87e5003ea600cbc522b1125a7be5e24a2c8ebf11c1bedbd761d783b93b: Status 404 returned error can't find the container with id bcb9be87e5003ea600cbc522b1125a7be5e24a2c8ebf11c1bedbd761d783b93b Oct 31 07:53:50.639495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:50.639474 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 07:53:51.237964 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:51.237932 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" event={"ID":"0289e4c2-ec1e-4c91-a3af-464962362949","Type":"ContainerStarted","Data":"ca583b3982af7a07198b7a5ade5f1c123bea05f8c751f48bed9ca4aefea4aba5"} Oct 31 07:53:51.238339 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:51.238006 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:53:51.238339 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:51.238032 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" event={"ID":"0289e4c2-ec1e-4c91-a3af-464962362949","Type":"ContainerStarted","Data":"bcb9be87e5003ea600cbc522b1125a7be5e24a2c8ebf11c1bedbd761d783b93b"} Oct 31 07:53:51.278221 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:51.278162 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" podStartSLOduration=1.752503007 podStartE2EDuration="2.278145777s" totalImagesPullingTime="525.64277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:53:51.277325553 +0000 UTC m=+1537.924324834" watchObservedRunningTime="2026-10-31 07:53:51.278145777 +0000 UTC m=+1537.925145060" Oct 31 07:53:57.248043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:53:57.248007 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:54:03.291341 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.291304 4406 generic.go:356] "Generic (PLEG): container finished" podID="e2137a68-ed2c-4941-8917-edeab147cafe" containerID="185f0aaea30c0fafa535da24c7a5c2769ff6f4f5c76f76f3d53759d12696c07e" exitCode=0 Oct 31 07:54:03.291780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.291378 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerDied","Data":"185f0aaea30c0fafa535da24c7a5c2769ff6f4f5c76f76f3d53759d12696c07e"} Oct 31 07:54:03.291780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.291770 4406 scope.go:122] "RemoveContainer" containerID="185f0aaea30c0fafa535da24c7a5c2769ff6f4f5c76f76f3d53759d12696c07e" Oct 31 07:54:03.293075 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.293045 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:54:03.293133 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.293116 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:54:03.293168 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:03.293153 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:54:04.297949 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:04.297916 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerStarted","Data":"3edb643a9353f921c3739cdb2407d261f948be4cc1e8971c7800919d896b4c4d"} Oct 31 07:54:05.244329 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:05.244296 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:54:05.245422 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:05.245390 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body= Oct 31 07:54:05.245555 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:05.245445 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" Oct 31 07:54:06.244691 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:06.244656 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body= Oct 31 07:54:06.245093 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:06.244709 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" Oct 31 07:54:07.176220 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:07.176182 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:54:07.244970 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:07.244929 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body= Oct 31 07:54:07.245409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:07.245007 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" Oct 31 07:54:08.244847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:08.244812 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body= Oct 31 07:54:08.245043 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:08.244868 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" Oct 31 07:54:09.244900 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:09.244862 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body= Oct 31 07:54:09.245111 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:09.244926 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" Oct 31 07:54:09.990285 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:54:09.990225 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:54:10.248508 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:10.248424 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:54:10.249565 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:54:10.249544 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:54:39.991192 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:54:39.991157 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:55:09.991297 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:55:09.991236 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:55:20.326178 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.326139 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:55:20.326757 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.326436 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" podUID="0289e4c2-ec1e-4c91-a3af-464962362949" containerName="maas-api" containerID="cri-o://ca583b3982af7a07198b7a5ade5f1c123bea05f8c751f48bed9ca4aefea4aba5" gracePeriod=30 Oct 31 07:55:20.736236 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.736046 4406 generic.go:356] "Generic (PLEG): container finished" podID="0289e4c2-ec1e-4c91-a3af-464962362949" containerID="ca583b3982af7a07198b7a5ade5f1c123bea05f8c751f48bed9ca4aefea4aba5" exitCode=0 Oct 31 07:55:20.736236 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.736161 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" event={"ID":"0289e4c2-ec1e-4c91-a3af-464962362949","Type":"ContainerDied","Data":"ca583b3982af7a07198b7a5ade5f1c123bea05f8c751f48bed9ca4aefea4aba5"} Oct 31 07:55:20.833415 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.833387 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:55:20.931572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.931485 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\" (UniqueName: \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\") pod \"0289e4c2-ec1e-4c91-a3af-464962362949\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " Oct 31 07:55:20.931572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.931540 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\") pod \"0289e4c2-ec1e-4c91-a3af-464962362949\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " Oct 31 07:55:20.931572 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.931570 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\") pod \"0289e4c2-ec1e-4c91-a3af-464962362949\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " Oct 31 07:55:20.931865 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.931631 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\") pod \"0289e4c2-ec1e-4c91-a3af-464962362949\" (UID: \"0289e4c2-ec1e-4c91-a3af-464962362949\") " Oct 31 07:55:20.932079 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.932051 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca" pod "0289e4c2-ec1e-4c91-a3af-464962362949" (UID: "0289e4c2-ec1e-4c91-a3af-464962362949"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:55:20.933789 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.933759 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls" pod "0289e4c2-ec1e-4c91-a3af-464962362949" (UID: "0289e4c2-ec1e-4c91-a3af-464962362949"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:55:20.933895 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.933785 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc" pod "0289e4c2-ec1e-4c91-a3af-464962362949" (UID: "0289e4c2-ec1e-4c91-a3af-464962362949"). InnerVolumeSpecName "kube-api-access-d4qhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:55:20.933895 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:20.933806 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs" pod "0289e4c2-ec1e-4c91-a3af-464962362949" (UID: "0289e4c2-ec1e-4c91-a3af-464962362949"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:55:21.033461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.033423 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4qhc\" (UniqueName: \"kubernetes.io/projected/0289e4c2-ec1e-4c91-a3af-464962362949-kube-api-access-d4qhc\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:21.033461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.033454 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:21.033461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.033463 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0289e4c2-ec1e-4c91-a3af-464962362949-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:21.033461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.033471 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0289e4c2-ec1e-4c91-a3af-464962362949-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:21.742612 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.742525 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" Oct 31 07:55:21.743120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.742517 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm" event={"ID":"0289e4c2-ec1e-4c91-a3af-464962362949","Type":"ContainerDied","Data":"bcb9be87e5003ea600cbc522b1125a7be5e24a2c8ebf11c1bedbd761d783b93b"} Oct 31 07:55:21.743120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.742676 4406 scope.go:122] "RemoveContainer" containerID="ca583b3982af7a07198b7a5ade5f1c123bea05f8c751f48bed9ca4aefea4aba5" Oct 31 07:55:21.789581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.789544 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:55:21.800429 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:21.800398 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm"] Oct 31 07:55:23.475782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:23.475750 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0289e4c2-ec1e-4c91-a3af-464962362949" path="/var/lib/kubelet/pods/0289e4c2-ec1e-4c91-a3af-464962362949/volumes" Oct 31 07:55:27.639479 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:27.639444 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:55:27.639976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:27.639699 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" containerID="cri-o://3edb643a9353f921c3739cdb2407d261f948be4cc1e8971c7800919d896b4c4d" gracePeriod=30 Oct 31 07:55:32.797712 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:32.797680 4406 generic.go:356] "Generic (PLEG): container finished" podID="e2137a68-ed2c-4941-8917-edeab147cafe" containerID="3edb643a9353f921c3739cdb2407d261f948be4cc1e8971c7800919d896b4c4d" exitCode=0 Oct 31 07:55:32.798129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:32.797760 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerDied","Data":"3edb643a9353f921c3739cdb2407d261f948be4cc1e8971c7800919d896b4c4d"} Oct 31 07:55:32.798129 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:32.797824 4406 scope.go:122] "RemoveContainer" containerID="185f0aaea30c0fafa535da24c7a5c2769ff6f4f5c76f76f3d53759d12696c07e" Oct 31 07:55:32.905456 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:32.905393 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:55:33.073506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073474 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073506 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073505 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073537 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073561 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073606 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073649 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073675 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.073744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073703 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073749 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\") pod \"e2137a68-ed2c-4941-8917-edeab147cafe\" (UID: \"e2137a68-ed2c-4941-8917-edeab147cafe\") " Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073791 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073804 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.073974 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074075 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:33.074154 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074117 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:33.074496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074272 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.074496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074287 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.074496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074302 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.074496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074314 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2137a68-ed2c-4941-8917-edeab147cafe-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.074496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.074330 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.075976 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.075952 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "kube-api-access-w66xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:55:33.076118 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.075996 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:33.076276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.076238 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:55:33.076345 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.076276 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo" pod "e2137a68-ed2c-4941-8917-edeab147cafe" (UID: "e2137a68-ed2c-4941-8917-edeab147cafe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:55:33.175096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.175010 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w66xg\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-kube-api-access-w66xg\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.175096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.175040 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2137a68-ed2c-4941-8917-edeab147cafe-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.175096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.175049 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2137a68-ed2c-4941-8917-edeab147cafe-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.175096 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.175058 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2137a68-ed2c-4941-8917-edeab147cafe-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:33.803199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.803109 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" event={"ID":"e2137a68-ed2c-4941-8917-edeab147cafe","Type":"ContainerDied","Data":"983eecd1eb841736565af726adb0e0a52fbe52db887871022b1845f4db81b272"} Oct 31 07:55:33.803199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.803143 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj" Oct 31 07:55:33.803199 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.803180 4406 scope.go:122] "RemoveContainer" containerID="3edb643a9353f921c3739cdb2407d261f948be4cc1e8971c7800919d896b4c4d" Oct 31 07:55:33.860626 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.860599 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:55:33.863452 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:33.863433 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-009b0f-openshift-default-5bdf4f6b5c5jwlj"] Oct 31 07:55:35.475262 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:35.475216 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" path="/var/lib/kubelet/pods/e2137a68-ed2c-4941-8917-edeab147cafe/volumes" Oct 31 07:55:39.992308 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:55:39.992275 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:55:56.714127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:56.714031 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:55:56.714782 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:56.714286 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" podUID="badc887c-71db-4007-be59-9bfc0dd2a452" containerName="manager" containerID="cri-o://29d26bb8ee0b3bfb3369d57be0a0c3e0914ba709f0b690d0bdfc93a2e7df4237" gracePeriod=10 Oct 31 07:55:56.899889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:56.899859 4406 generic.go:356] "Generic (PLEG): container finished" podID="badc887c-71db-4007-be59-9bfc0dd2a452" containerID="29d26bb8ee0b3bfb3369d57be0a0c3e0914ba709f0b690d0bdfc93a2e7df4237" exitCode=0 Oct 31 07:55:56.900018 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:56.899931 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" event={"ID":"badc887c-71db-4007-be59-9bfc0dd2a452","Type":"ContainerDied","Data":"29d26bb8ee0b3bfb3369d57be0a0c3e0914ba709f0b690d0bdfc93a2e7df4237"} Oct 31 07:55:56.979513 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:56.979485 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:55:57.103100 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.103068 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\" (UniqueName: \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\") pod \"badc887c-71db-4007-be59-9bfc0dd2a452\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " Oct 31 07:55:57.103276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.103127 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\") pod \"badc887c-71db-4007-be59-9bfc0dd2a452\" (UID: \"badc887c-71db-4007-be59-9bfc0dd2a452\") " Oct 31 07:55:57.103571 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.103547 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume" pod "badc887c-71db-4007-be59-9bfc0dd2a452" (UID: "badc887c-71db-4007-be59-9bfc0dd2a452"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:55:57.105272 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.105235 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km" pod "badc887c-71db-4007-be59-9bfc0dd2a452" (UID: "badc887c-71db-4007-be59-9bfc0dd2a452"). InnerVolumeSpecName "kube-api-access-kx8km". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:55:57.204309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.204245 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx8km\" (UniqueName: \"kubernetes.io/projected/badc887c-71db-4007-be59-9bfc0dd2a452-kube-api-access-kx8km\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:57.204309 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.204303 4406 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badc887c-71db-4007-be59-9bfc0dd2a452-extensions-socket-volume\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:55:57.906005 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.905979 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" Oct 31 07:55:57.906005 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.906009 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk" event={"ID":"badc887c-71db-4007-be59-9bfc0dd2a452","Type":"ContainerDied","Data":"1ed8d05383816d9c92fda4964aef0458b587d98786abd27c38913d942bcf7213"} Oct 31 07:55:57.906530 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.906062 4406 scope.go:122] "RemoveContainer" containerID="29d26bb8ee0b3bfb3369d57be0a0c3e0914ba709f0b690d0bdfc93a2e7df4237" Oct 31 07:55:57.968409 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.964629 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:55:57.973840 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:57.973811 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-px4mk"] Oct 31 07:55:59.477961 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:55:59.477922 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="badc887c-71db-4007-be59-9bfc0dd2a452" path="/var/lib/kubelet/pods/badc887c-71db-4007-be59-9bfc0dd2a452/volumes" Oct 31 07:56:09.990691 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:56:09.990654 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:56:39.990606 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:56:39.990559 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:56:59.882575 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882541 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v"] Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882906 4406 cpu_manager.go:414] "containerMap: removing container" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882919 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882934 4406 cpu_manager.go:414] "containerMap: removing container" podUID="badc887c-71db-4007-be59-9bfc0dd2a452" containerName="manager" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882939 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="badc887c-71db-4007-be59-9bfc0dd2a452" containerName="manager" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882946 4406 cpu_manager.go:414] "containerMap: removing container" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882951 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882967 4406 cpu_manager.go:414] "containerMap: removing container" podUID="0289e4c2-ec1e-4c91-a3af-464962362949" containerName="maas-api" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.882971 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0289e4c2-ec1e-4c91-a3af-464962362949" containerName="maas-api" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.883026 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="0289e4c2-ec1e-4c91-a3af-464962362949" containerName="maas-api" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.883036 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.883042 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="badc887c-71db-4007-be59-9bfc0dd2a452" containerName="manager" Oct 31 07:56:59.883067 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.883048 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2137a68-ed2c-4941-8917-edeab147cafe" containerName="istio-proxy" Oct 31 07:56:59.886065 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.886048 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:56:59.905110 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.905083 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:56:59.905275 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.905134 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbz8\" (UniqueName: \"kubernetes.io/projected/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-kube-api-access-9sbz8\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:56:59.910388 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.910363 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 31 07:56:59.910388 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.910369 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xkk64\"" Oct 31 07:56:59.910558 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.910454 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 31 07:56:59.912975 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:56:59.912952 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v"] Oct 31 07:57:00.006120 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.006089 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:00.006301 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.006136 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbz8\" (UniqueName: \"kubernetes.io/projected/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-kube-api-access-9sbz8\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:00.006495 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.006477 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:00.027808 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.027780 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbz8\" (UniqueName: \"kubernetes.io/projected/bcd5f1b7-ae22-42d6-84b0-0833aa31aae9-kube-api-access-9sbz8\") pod \"kuadrant-operator-controller-manager-678d87766f-58c8v\" (UID: \"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:00.198864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.198788 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:00.515135 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:00.515049 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v"] Oct 31 07:57:00.518851 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:57:00.518823 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd5f1b7_ae22_42d6_84b0_0833aa31aae9.slice/crio-1d321661973969d17b46e46e58c39ba6fe4f3b539eebfc42eed127fd4c5879a7 WatchSource:0}: Error finding container 1d321661973969d17b46e46e58c39ba6fe4f3b539eebfc42eed127fd4c5879a7: Status 404 returned error can't find the container with id 1d321661973969d17b46e46e58c39ba6fe4f3b539eebfc42eed127fd4c5879a7 Oct 31 07:57:01.177815 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:01.177766 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" event={"ID":"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9","Type":"ContainerStarted","Data":"df08282e28ac1b52e47b2b55bf57f81845a9e62657cb5ede9906bf6744edb266"} Oct 31 07:57:01.178304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:01.177903 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:01.178304 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:01.177932 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" event={"ID":"bcd5f1b7-ae22-42d6-84b0-0833aa31aae9","Type":"ContainerStarted","Data":"1d321661973969d17b46e46e58c39ba6fe4f3b539eebfc42eed127fd4c5879a7"} Oct 31 07:57:01.241352 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:01.241299 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" podStartSLOduration=2.241285263 podStartE2EDuration="2.241285263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:57:01.228954899 +0000 UTC m=+1727.875954180" watchObservedRunningTime="2026-10-31 07:57:01.241285263 +0000 UTC m=+1727.888284544" Oct 31 07:57:09.991410 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:57:09.991372 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:57:12.184888 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:57:12.184859 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-58c8v" Oct 31 07:57:39.990871 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:57:39.990831 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:58:09.990859 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:58:09.990821 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:58:30.746750 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.746715 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:58:30.751453 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.751339 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.769292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.769264 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-11a81e-openshift-default-dockercfg-2lhj2\"" Oct 31 07:58:30.779770 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.779743 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:58:30.831728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831688 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.831728 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831732 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.831948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831828 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.831948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831850 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.831948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831875 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.831948 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831927 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.832095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.831985 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.832095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.832017 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwwdb\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.832095 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.832044 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933243 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933200 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933276 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933326 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933371 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwwdb\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933397 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933432 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933473 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933465 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933544 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933780 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933688 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933801 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933806 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.933889 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.933837 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.934078 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.934053 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.934202 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.934184 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.936061 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.936031 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.936292 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.936246 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.955924 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.955896 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:30.956214 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:30.956195 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwwdb\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\") pod \"e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:31.067332 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.067237 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:31.380177 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.380151 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:58:31.382842 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:58:31.382818 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a982c7_f073_40f7_a329_7c6ef5558854.slice/crio-7f8fbc8adab87e4443a28f3d110fb58f58a7057f361dfcae72f029f1b975a65a WatchSource:0}: Error finding container 7f8fbc8adab87e4443a28f3d110fb58f58a7057f361dfcae72f029f1b975a65a: Status 404 returned error can't find the container with id 7f8fbc8adab87e4443a28f3d110fb58f58a7057f361dfcae72f029f1b975a65a Oct 31 07:58:31.385048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.385016 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:31.385124 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.385087 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:31.385124 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.385117 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:31.596987 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.596956 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerStarted","Data":"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c"} Oct 31 07:58:31.597191 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.597003 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerStarted","Data":"7f8fbc8adab87e4443a28f3d110fb58f58a7057f361dfcae72f029f1b975a65a"} Oct 31 07:58:31.637886 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:31.637764 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podStartSLOduration=1.637742653 podStartE2EDuration="1.637742653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:58:31.633718528 +0000 UTC m=+1818.280717810" watchObservedRunningTime="2026-10-31 07:58:31.637742653 +0000 UTC m=+1818.284741950" Oct 31 07:58:32.067907 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:32.067819 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:32.072887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:32.072857 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:32.601106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:32.601073 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:32.601985 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:32.601967 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:35.388692 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.388656 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:58:35.392744 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.392719 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.408562 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.408535 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:58:35.420384 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.420359 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-11a81e-serving-cert\"" Oct 31 07:58:35.487231 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.487198 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.487427 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.487237 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.487427 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.487292 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.487549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.487450 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6wj\" (UniqueName: \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.588904 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.588825 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.588904 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.588876 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.589118 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.588913 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.589118 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.588962 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6wj\" (UniqueName: \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.589736 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.589695 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.592277 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.592213 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.593037 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.593012 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.607953 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.607926 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6wj\" (UniqueName: \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\") pod \"maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:35.719421 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:35.719337 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:36.015070 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:36.014993 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:58:36.018107 ip-10-0-136-217 kubenswrapper[4406]: W1031 07:58:36.018073 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5556487_1d67_4930_a0a4_58499e89c103.slice/crio-032c42dfa5c559c4e6e7c1b7c93bf7ad99935d1606c500f625f15cd5d8254b4a WatchSource:0}: Error finding container 032c42dfa5c559c4e6e7c1b7c93bf7ad99935d1606c500f625f15cd5d8254b4a: Status 404 returned error can't find the container with id 032c42dfa5c559c4e6e7c1b7c93bf7ad99935d1606c500f625f15cd5d8254b4a Oct 31 07:58:36.620496 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:36.620458 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" event={"ID":"c5556487-1d67-4930-a0a4-58499e89c103","Type":"ContainerStarted","Data":"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535"} Oct 31 07:58:36.620871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:36.620507 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" event={"ID":"c5556487-1d67-4930-a0a4-58499e89c103","Type":"ContainerStarted","Data":"032c42dfa5c559c4e6e7c1b7c93bf7ad99935d1606c500f625f15cd5d8254b4a"} Oct 31 07:58:36.620871 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:36.620595 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:36.659461 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:36.659406 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" podStartSLOduration=1.257227219 podStartE2EDuration="1.659392628s" totalImagesPullingTime="402.165409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:58:36.658229272 +0000 UTC m=+1823.305228558" watchObservedRunningTime="2026-10-31 07:58:36.659392628 +0000 UTC m=+1823.306391909" Oct 31 07:58:39.991281 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:58:39.991229 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:58:42.634284 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:42.634233 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:58:48.227483 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.226597 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": read tcp 10.133.0.2:42162->10.133.0.79:15021: read: connection reset by peer" start-of-body= Oct 31 07:58:48.227483 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.226678 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": read tcp 10.133.0.2:42162->10.133.0.79:15021: read: connection reset by peer" Oct 31 07:58:48.683581 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.683547 4406 generic.go:356] "Generic (PLEG): container finished" podID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerID="8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c" exitCode=0 Oct 31 07:58:48.683763 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.683617 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerDied","Data":"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c"} Oct 31 07:58:48.684032 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.684017 4406 scope.go:122] "RemoveContainer" containerID="8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c" Oct 31 07:58:48.685190 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.685164 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:48.685276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.685230 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:48.685311 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:48.685289 4406 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 31 07:58:49.690136 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:49.690104 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerStarted","Data":"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef"} Oct 31 07:58:50.067887 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:50.067788 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:50.068276 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:50.068169 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body= Oct 31 07:58:50.068484 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:50.068463 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" Oct 31 07:58:51.067730 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:51.067694 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body= Oct 31 07:58:51.068142 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:51.067749 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" Oct 31 07:58:52.068672 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:52.068627 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body= Oct 31 07:58:52.069103 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:52.068696 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" Oct 31 07:58:53.068211 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:53.068177 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body= Oct 31 07:58:53.068444 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:53.068231 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" Oct 31 07:58:54.067601 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:54.067564 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body= Oct 31 07:58:54.068048 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:54.067622 4406 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" Oct 31 07:58:55.219597 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:55.219457 4406 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:55.220466 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:55.220443 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:58:55.227169 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:58:55.227144 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:59:09.991552 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:59:09.991465 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:59:39.990920 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:59:39.990872 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 07:59:44.470117 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.470081 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:59:44.470638 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.470319 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" podUID="c5556487-1d67-4930-a0a4-58499e89c103" containerName="maas-api" containerID="cri-o://ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535" gracePeriod=30 Oct 31 07:59:44.967313 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.967240 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:59:44.967454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.967316 4406 generic.go:356] "Generic (PLEG): container finished" podID="c5556487-1d67-4930-a0a4-58499e89c103" containerID="ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535" exitCode=0 Oct 31 07:59:44.967454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.967362 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" event={"ID":"c5556487-1d67-4930-a0a4-58499e89c103","Type":"ContainerDied","Data":"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535"} Oct 31 07:59:44.967454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.967429 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" event={"ID":"c5556487-1d67-4930-a0a4-58499e89c103","Type":"ContainerDied","Data":"032c42dfa5c559c4e6e7c1b7c93bf7ad99935d1606c500f625f15cd5d8254b4a"} Oct 31 07:59:44.967567 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.967459 4406 scope.go:122] "RemoveContainer" containerID="ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535" Oct 31 07:59:44.976267 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.976227 4406 scope.go:122] "RemoveContainer" containerID="ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535" Oct 31 07:59:44.976630 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:59:44.976597 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535\": container with ID starting with ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535 not found: ID does not exist" containerID="ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535" Oct 31 07:59:44.976759 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:44.976641 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535"} err="failed to get container status \"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535\": rpc error: code = NotFound desc = could not find container \"ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535\": container with ID starting with ef86a66894c23002228418cee60ec6a0648e964a781a1403e4379d63fd33a535 not found: ID does not exist" Oct 31 07:59:45.030960 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.030876 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\") pod \"c5556487-1d67-4930-a0a4-58499e89c103\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " Oct 31 07:59:45.031121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.030958 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\") pod \"c5556487-1d67-4930-a0a4-58499e89c103\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " Oct 31 07:59:45.031121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.031060 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\") pod \"c5556487-1d67-4930-a0a4-58499e89c103\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " Oct 31 07:59:45.031121 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.031108 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\" (UniqueName: \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\") pod \"c5556487-1d67-4930-a0a4-58499e89c103\" (UID: \"c5556487-1d67-4930-a0a4-58499e89c103\") " Oct 31 07:59:45.031333 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.031307 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca" pod "c5556487-1d67-4930-a0a4-58499e89c103" (UID: "c5556487-1d67-4930-a0a4-58499e89c103"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:59:45.031549 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.031527 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5556487-1d67-4930-a0a4-58499e89c103-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:45.033070 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.033050 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs" pod "c5556487-1d67-4930-a0a4-58499e89c103" (UID: "c5556487-1d67-4930-a0a4-58499e89c103"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:59:45.033553 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.033531 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls" pod "c5556487-1d67-4930-a0a4-58499e89c103" (UID: "c5556487-1d67-4930-a0a4-58499e89c103"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 07:59:45.033661 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.033636 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj" pod "c5556487-1d67-4930-a0a4-58499e89c103" (UID: "c5556487-1d67-4930-a0a4-58499e89c103"). InnerVolumeSpecName "kube-api-access-8n6wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:59:45.133026 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.132997 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:45.133026 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.133022 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5556487-1d67-4930-a0a4-58499e89c103-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:45.133026 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.133031 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n6wj\" (UniqueName: \"kubernetes.io/projected/c5556487-1d67-4930-a0a4-58499e89c103-kube-api-access-8n6wj\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:45.972459 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:45.972416 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc" Oct 31 07:59:46.017847 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:46.017814 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:59:46.029761 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:46.029731 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc"] Oct 31 07:59:47.477231 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:47.477199 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5556487-1d67-4930-a0a4-58499e89c103" path="/var/lib/kubelet/pods/c5556487-1d67-4930-a0a4-58499e89c103/volumes" Oct 31 07:59:51.764454 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:51.764419 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:59:51.764893 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:51.764670 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" containerID="cri-o://147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef" gracePeriod=30 Oct 31 07:59:55.222648 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:55.222610 4406 patch_prober.go:29] interesting pod/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 07:59:55.223106 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:55.222675 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 07:59:57.015596 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.015572 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:59:57.026068 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.026040 4406 generic.go:356] "Generic (PLEG): container finished" podID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerID="147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef" exitCode=0 Oct 31 07:59:57.026183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.026089 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" Oct 31 07:59:57.026183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.026119 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerDied","Data":"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef"} Oct 31 07:59:57.026183 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.026170 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv" event={"ID":"c1a982c7-f073-40f7-a329-7c6ef5558854","Type":"ContainerDied","Data":"7f8fbc8adab87e4443a28f3d110fb58f58a7057f361dfcae72f029f1b975a65a"} Oct 31 07:59:57.026303 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.026192 4406 scope.go:122] "RemoveContainer" containerID="147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef" Oct 31 07:59:57.034188 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.034173 4406 scope.go:122] "RemoveContainer" containerID="8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c" Oct 31 07:59:57.041526 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.041509 4406 scope.go:122] "RemoveContainer" containerID="147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef" Oct 31 07:59:57.041813 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:59:57.041787 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef\": container with ID starting with 147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef not found: ID does not exist" containerID="147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef" Oct 31 07:59:57.041864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.041824 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef"} err="failed to get container status \"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef\": rpc error: code = NotFound desc = could not find container \"147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef\": container with ID starting with 147ce2f904e9c5628f825e942270ea1a08cb22fe96baff1289465001924bd7ef not found: ID does not exist" Oct 31 07:59:57.041864 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.041840 4406 scope.go:122] "RemoveContainer" containerID="8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c" Oct 31 07:59:57.042068 ip-10-0-136-217 kubenswrapper[4406]: E1031 07:59:57.042047 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c\": container with ID starting with 8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c not found: ID does not exist" containerID="8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c" Oct 31 07:59:57.042155 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.042073 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c"} err="failed to get container status \"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c\": rpc error: code = NotFound desc = could not find container \"8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c\": container with ID starting with 8c7f43f1559aa23aa337036c68efd96448f2a9250570a81cdbb9bb97d510900c not found: ID does not exist" Oct 31 07:59:57.154167 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154137 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154167 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154172 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154219 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154277 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154320 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154346 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154441 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154393 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154453 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154483 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\") pod \"c1a982c7-f073-40f7-a329-7c6ef5558854\" (UID: \"c1a982c7-f073-40f7-a329-7c6ef5558854\") " Oct 31 07:59:57.154697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154493 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:59:57.154697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154573 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:59:57.154697 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154650 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:59:57.154942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154754 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:59:57.154942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154904 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.154942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154911 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 07:59:57.154942 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154924 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.155152 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154951 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.155152 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.154970 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.156502 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.156474 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 07:59:57.156595 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.156522 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 07:59:57.156638 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.156591 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:59:57.156677 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.156659 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb" pod "c1a982c7-f073-40f7-a329-7c6ef5558854" (UID: "c1a982c7-f073-40f7-a329-7c6ef5558854"). InnerVolumeSpecName "kube-api-access-nwwdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 07:59:57.255922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.255891 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwwdb\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-kube-api-access-nwwdb\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.255922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.255917 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a982c7-f073-40f7-a329-7c6ef5558854-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.255922 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.255926 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.256127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.255933 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.256127 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.255941 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a982c7-f073-40f7-a329-7c6ef5558854-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 07:59:57.366335 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.366281 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:59:57.377050 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.377028 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11a81e-openshift-default-dfb59d49c-8qhsv"] Oct 31 07:59:57.475503 ip-10-0-136-217 kubenswrapper[4406]: I1031 07:59:57.475475 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" path="/var/lib/kubelet/pods/c1a982c7-f073-40f7-a329-7c6ef5558854/volumes" Oct 31 08:00:09.991126 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:00:09.991078 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:00:39.991494 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:00:39.991453 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:01:09.993396 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:01:09.993363 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:01:23.082275 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:01:23.080669 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-6g544 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 08:01:23.082275 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:01:23.080739 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 08:01:39.990550 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:01:39.990514 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:02:09.991694 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:02:09.991614 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:02:26.329284 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329227 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr"] Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329589 4406 cpu_manager.go:414] "containerMap: removing container" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329600 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329629 4406 cpu_manager.go:414] "containerMap: removing container" podUID="c5556487-1d67-4930-a0a4-58499e89c103" containerName="maas-api" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329634 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5556487-1d67-4930-a0a4-58499e89c103" containerName="maas-api" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329696 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5556487-1d67-4930-a0a4-58499e89c103" containerName="maas-api" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329705 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:26.329870 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.329712 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:26.332700 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.332676 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.360364 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.360329 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr"] Oct 31 08:02:26.407628 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.407596 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-maas-api-tls\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.407791 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.407656 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a615321-5cfd-4712-ac2f-470c6b1f0e59-openshift-service-ca\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.407791 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.407757 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgz8s\" (UniqueName: \"kubernetes.io/projected/0a615321-5cfd-4712-ac2f-470c6b1f0e59-kube-api-access-zgz8s\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.407893 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.407800 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-metrics-certs\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.509000 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.508961 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a615321-5cfd-4712-ac2f-470c6b1f0e59-openshift-service-ca\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.509184 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.509014 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgz8s\" (UniqueName: \"kubernetes.io/projected/0a615321-5cfd-4712-ac2f-470c6b1f0e59-kube-api-access-zgz8s\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.509184 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.509046 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-metrics-certs\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.509184 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.509073 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-maas-api-tls\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.509840 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.509817 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a615321-5cfd-4712-ac2f-470c6b1f0e59-openshift-service-ca\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.511452 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.511433 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-metrics-certs\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.511508 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.511457 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a615321-5cfd-4712-ac2f-470c6b1f0e59-maas-api-tls\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.526240 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.526208 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgz8s\" (UniqueName: \"kubernetes.io/projected/0a615321-5cfd-4712-ac2f-470c6b1f0e59-kube-api-access-zgz8s\") pod \"maas-api-f4d8b9659-rbhwr\" (UID: \"0a615321-5cfd-4712-ac2f-470c6b1f0e59\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.648210 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.648129 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:26.936639 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.936559 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr"] Oct 31 08:02:26.940139 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:02:26.940112 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a615321_5cfd_4712_ac2f_470c6b1f0e59.slice/crio-216e17f1badfa14000ae049364c5696ad3bf6bb9b1d1d8abd69310c652fdfbfa WatchSource:0}: Error finding container 216e17f1badfa14000ae049364c5696ad3bf6bb9b1d1d8abd69310c652fdfbfa: Status 404 returned error can't find the container with id 216e17f1badfa14000ae049364c5696ad3bf6bb9b1d1d8abd69310c652fdfbfa Oct 31 08:02:26.941412 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:26.941392 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 08:02:27.823033 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:27.822999 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" event={"ID":"0a615321-5cfd-4712-ac2f-470c6b1f0e59","Type":"ContainerStarted","Data":"dd2d8c94641c641864683318a2ee1531f0e16710eb673459a287e29fe06d94bc"} Oct 31 08:02:27.823473 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:27.823048 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" event={"ID":"0a615321-5cfd-4712-ac2f-470c6b1f0e59","Type":"ContainerStarted","Data":"216e17f1badfa14000ae049364c5696ad3bf6bb9b1d1d8abd69310c652fdfbfa"} Oct 31 08:02:27.823473 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:27.823136 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:27.861081 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:27.861017 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" podStartSLOduration=1.48584729 podStartE2EDuration="1.861000844s" totalImagesPullingTime="375.153554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:27.859108847 +0000 UTC m=+2054.506108129" watchObservedRunningTime="2026-10-31 08:02:27.861000844 +0000 UTC m=+2054.508000125" Oct 31 08:02:33.832638 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:33.832611 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr" Oct 31 08:02:39.990521 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:02:39.990482 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:02:41.913478 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:41.913431 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 08:02:41.914010 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:41.913706 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" podUID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" containerName="maas-api" containerID="cri-o://4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f" gracePeriod=30 Oct 31 08:02:43.159548 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.159520 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 08:02:43.161532 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.161515 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\") pod \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " Oct 31 08:02:43.161604 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.161563 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\") pod \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " Oct 31 08:02:43.161645 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.161629 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\" (UniqueName: \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\") pod \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " Oct 31 08:02:43.161678 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.161656 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\") pod \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\" (UID: \"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9\") " Oct 31 08:02:43.161938 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.161907 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca" pod "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" (UID: "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:02:43.163579 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.163552 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs" pod "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" (UID: "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:02:43.163676 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.163604 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls" pod "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" (UID: "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:02:43.163676 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.163625 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2" pod "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" (UID: "8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9"). InnerVolumeSpecName "kube-api-access-htlv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:02:43.262557 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.262473 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:02:43.262557 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.262501 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:02:43.262557 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.262510 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:02:43.262557 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.262520 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htlv2\" (UniqueName: \"kubernetes.io/projected/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9-kube-api-access-htlv2\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:02:43.892721 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.892687 4406 generic.go:356] "Generic (PLEG): container finished" podID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" containerID="4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f" exitCode=0 Oct 31 08:02:43.892909 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.892732 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" Oct 31 08:02:43.892909 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.892734 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" event={"ID":"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9","Type":"ContainerDied","Data":"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f"} Oct 31 08:02:43.892909 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.892855 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r" event={"ID":"8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9","Type":"ContainerDied","Data":"af5af8cac31ee02cc0d3cd0ed8c0479e39893a8d31a358b255c8aef341a7c7c0"} Oct 31 08:02:43.892909 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.892886 4406 scope.go:122] "RemoveContainer" containerID="4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f" Oct 31 08:02:43.901420 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.901401 4406 scope.go:122] "RemoveContainer" containerID="4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f" Oct 31 08:02:43.901740 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:02:43.901716 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f\": container with ID starting with 4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f not found: ID does not exist" containerID="4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f" Oct 31 08:02:43.901850 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.901747 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f"} err="failed to get container status \"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f\": rpc error: code = NotFound desc = could not find container \"4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f\": container with ID starting with 4fa0ea714dce0cfb1aee1e1389a7a11e9249bb4549bff74486f41f282205a69f not found: ID does not exist" Oct 31 08:02:43.937736 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.937699 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 08:02:43.948468 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:43.948435 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r"] Oct 31 08:02:45.475800 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:45.475768 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" path="/var/lib/kubelet/pods/8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9/volumes" Oct 31 08:02:49.451496 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451464 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:02:49.451898 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451813 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" containerName="maas-api" Oct 31 08:02:49.451898 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451831 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" containerName="maas-api" Oct 31 08:02:49.451898 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451855 4406 cpu_manager.go:414] "containerMap: removing container" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:49.451898 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451861 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1a982c7-f073-40f7-a329-7c6ef5558854" containerName="istio-proxy" Oct 31 08:02:49.452049 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.451917 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ae51ead-2f1a-4b6f-8abf-f04cbd82ddd9" containerName="maas-api" Oct 31 08:02:49.456126 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.456107 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.470199 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.470178 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-fd18eeb3\"" Oct 31 08:02:49.477082 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.477058 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:02:49.481701 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.481678 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-fd18eeb3-dockercfg-2fdzs\"" Oct 31 08:02:49.531086 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.531050 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.531489 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.531462 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nt8q\" (UniqueName: \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.632496 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.632462 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt8q\" (UniqueName: \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.632658 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.632554 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.633214 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.633195 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.649979 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.649954 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt8q\" (UniqueName: \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\") pod \"payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:49.768698 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:49.768614 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:50.062385 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.061915 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:02:50.067635 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:02:50.067605 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759ba15b_c3f0_498c_a89c_707df8f57a57.slice/crio-c1319198cd50c46d2286510c5756ccce97ee2c2292a0650377063a1804be5939 WatchSource:0}: Error finding container c1319198cd50c46d2286510c5756ccce97ee2c2292a0650377063a1804be5939: Status 404 returned error can't find the container with id c1319198cd50c46d2286510c5756ccce97ee2c2292a0650377063a1804be5939 Oct 31 08:02:50.406284 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.406233 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:02:50.409779 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.409758 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.427908 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.427885 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fd18eeb3-serving-cert\"" Oct 31 08:02:50.438173 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.438145 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:02:50.439772 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.439746 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.439887 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.439818 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5k9\" (UniqueName: \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.439975 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.439945 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.440038 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.440022 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.541230 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.541196 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.541624 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.541299 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.541624 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.541336 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5k9\" (UniqueName: \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.541624 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.541359 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.541624 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:02:50.541451 4406 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-serving-cert: secret "maas-api-e2e-ait-fd18eeb3-serving-cert" not found Oct 31 08:02:50.541624 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:02:50.541540 4406 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls podName:66c43ba7-7c41-4b62-a311-b869a0908d33 nodeName:}" failed. No retries permitted until 2026-10-31 08:02:51.041501721 +0000 UTC m=+2077.688501003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls") pod "maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" (UID: "66c43ba7-7c41-4b62-a311-b869a0908d33") : secret "maas-api-e2e-ait-fd18eeb3-serving-cert" not found Oct 31 08:02:50.541989 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.541966 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.543708 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.543690 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.559607 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.559582 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5k9\" (UniqueName: \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:50.924821 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.924789 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" event={"ID":"759ba15b-c3f0-498c-a89c-707df8f57a57","Type":"ContainerStarted","Data":"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de"} Oct 31 08:02:50.924994 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.924841 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" event={"ID":"759ba15b-c3f0-498c-a89c-707df8f57a57","Type":"ContainerStarted","Data":"c1319198cd50c46d2286510c5756ccce97ee2c2292a0650377063a1804be5939"} Oct 31 08:02:50.924994 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.924919 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:02:50.973926 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:50.973875 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" podStartSLOduration=1.973861017 podStartE2EDuration="1.973861017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:50.972906215 +0000 UTC m=+2077.619905495" watchObservedRunningTime="2026-10-31 08:02:50.973861017 +0000 UTC m=+2077.620860312" Oct 31 08:02:51.049105 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:51.049076 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:51.051303 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:51.051281 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") pod \"maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:51.321549 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:51.321459 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:51.615206 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:51.615173 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:02:51.618288 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:02:51.618259 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c43ba7_7c41_4b62_a311_b869a0908d33.slice/crio-1d772867c4047528c88388eb1ebfcb00664e7b88629832ad33efeaa67233daba WatchSource:0}: Error finding container 1d772867c4047528c88388eb1ebfcb00664e7b88629832ad33efeaa67233daba: Status 404 returned error can't find the container with id 1d772867c4047528c88388eb1ebfcb00664e7b88629832ad33efeaa67233daba Oct 31 08:02:51.930010 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:51.929931 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" event={"ID":"66c43ba7-7c41-4b62-a311-b869a0908d33","Type":"ContainerStarted","Data":"1d772867c4047528c88388eb1ebfcb00664e7b88629832ad33efeaa67233daba"} Oct 31 08:02:52.936736 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:52.936698 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" event={"ID":"66c43ba7-7c41-4b62-a311-b869a0908d33","Type":"ContainerStarted","Data":"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c"} Oct 31 08:02:52.937146 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:52.936847 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:02:52.972796 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:52.972732 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" podStartSLOduration=2.655779162 podStartE2EDuration="2.972715924s" totalImagesPullingTime="316.936762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:52.972389844 +0000 UTC m=+2079.619389126" watchObservedRunningTime="2026-10-31 08:02:52.972715924 +0000 UTC m=+2079.619715207" Oct 31 08:02:58.947592 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:02:58.947565 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:03:01.933107 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:01.933079 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:03:09.991070 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:03:09.991031 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:03:27.837822 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:27.837723 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:03:30.565366 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.565331 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:03:30.565817 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.565579 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" podUID="66c43ba7-7c41-4b62-a311-b869a0908d33" containerName="maas-api" containerID="cri-o://cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c" gracePeriod=30 Oct 31 08:03:30.858909 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.858883 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:03:30.953168 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.953130 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\" (UniqueName: \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\") pod \"66c43ba7-7c41-4b62-a311-b869a0908d33\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " Oct 31 08:03:30.953453 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.953292 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") pod \"66c43ba7-7c41-4b62-a311-b869a0908d33\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " Oct 31 08:03:30.953453 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.953387 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\") pod \"66c43ba7-7c41-4b62-a311-b869a0908d33\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " Oct 31 08:03:30.953453 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.953448 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\") pod \"66c43ba7-7c41-4b62-a311-b869a0908d33\" (UID: \"66c43ba7-7c41-4b62-a311-b869a0908d33\") " Oct 31 08:03:30.955713 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.955649 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca" pod "66c43ba7-7c41-4b62-a311-b869a0908d33" (UID: "66c43ba7-7c41-4b62-a311-b869a0908d33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:03:30.956202 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.956180 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs" pod "66c43ba7-7c41-4b62-a311-b869a0908d33" (UID: "66c43ba7-7c41-4b62-a311-b869a0908d33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:03:30.958213 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.958185 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls" pod "66c43ba7-7c41-4b62-a311-b869a0908d33" (UID: "66c43ba7-7c41-4b62-a311-b869a0908d33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:03:30.965017 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:30.964986 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9" pod "66c43ba7-7c41-4b62-a311-b869a0908d33" (UID: "66c43ba7-7c41-4b62-a311-b869a0908d33"). InnerVolumeSpecName "kube-api-access-dm5k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:03:31.054475 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.054441 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:31.054475 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.054470 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66c43ba7-7c41-4b62-a311-b869a0908d33-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:31.054475 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.054480 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66c43ba7-7c41-4b62-a311-b869a0908d33-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:31.054723 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.054489 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm5k9\" (UniqueName: \"kubernetes.io/projected/66c43ba7-7c41-4b62-a311-b869a0908d33-kube-api-access-dm5k9\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:31.117436 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.117347 4406 generic.go:356] "Generic (PLEG): container finished" podID="66c43ba7-7c41-4b62-a311-b869a0908d33" containerID="cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c" exitCode=0 Oct 31 08:03:31.117436 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.117422 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" Oct 31 08:03:31.117648 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.117447 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" event={"ID":"66c43ba7-7c41-4b62-a311-b869a0908d33","Type":"ContainerDied","Data":"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c"} Oct 31 08:03:31.117648 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.117546 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f" event={"ID":"66c43ba7-7c41-4b62-a311-b869a0908d33","Type":"ContainerDied","Data":"1d772867c4047528c88388eb1ebfcb00664e7b88629832ad33efeaa67233daba"} Oct 31 08:03:31.117648 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.117577 4406 scope.go:122] "RemoveContainer" containerID="cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c" Oct 31 08:03:31.127415 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.127398 4406 scope.go:122] "RemoveContainer" containerID="cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c" Oct 31 08:03:31.127678 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:03:31.127657 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c\": container with ID starting with cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c not found: ID does not exist" containerID="cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c" Oct 31 08:03:31.127723 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.127689 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c"} err="failed to get container status \"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c\": rpc error: code = NotFound desc = could not find container \"cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c\": container with ID starting with cf750ca89ed35a3fbdccaf042eb64f9bc9c54c99c2c76865190922c0788a969c not found: ID does not exist" Oct 31 08:03:31.163672 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.163644 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:03:31.174335 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.174312 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f"] Oct 31 08:03:31.475295 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:31.475213 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66c43ba7-7c41-4b62-a311-b869a0908d33" path="/var/lib/kubelet/pods/66c43ba7-7c41-4b62-a311-b869a0908d33/volumes" Oct 31 08:03:32.839087 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:32.839025 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" podUID="759ba15b-c3f0-498c-a89c-707df8f57a57" containerName="payload-pre-processing" containerID="cri-o://eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de" gracePeriod=25 Oct 31 08:03:33.091771 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.091715 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:03:33.135633 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.135010 4406 generic.go:356] "Generic (PLEG): container finished" podID="759ba15b-c3f0-498c-a89c-707df8f57a57" containerID="eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de" exitCode=0 Oct 31 08:03:33.135633 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.135144 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" event={"ID":"759ba15b-c3f0-498c-a89c-707df8f57a57","Type":"ContainerDied","Data":"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de"} Oct 31 08:03:33.135633 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.135189 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" event={"ID":"759ba15b-c3f0-498c-a89c-707df8f57a57","Type":"ContainerDied","Data":"c1319198cd50c46d2286510c5756ccce97ee2c2292a0650377063a1804be5939"} Oct 31 08:03:33.135633 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.135220 4406 scope.go:122] "RemoveContainer" containerID="eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de" Oct 31 08:03:33.135633 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.135339 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5" Oct 31 08:03:33.146391 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.146369 4406 scope.go:122] "RemoveContainer" containerID="eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de" Oct 31 08:03:33.146879 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:03:33.146852 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de\": container with ID starting with eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de not found: ID does not exist" containerID="eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de" Oct 31 08:03:33.146974 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.146890 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de"} err="failed to get container status \"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de\": rpc error: code = NotFound desc = could not find container \"eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de\": container with ID starting with eb689f064263be2a2c4ced405af6b62bc812e6b41c7c35cb5bd7ff89f16087de not found: ID does not exist" Oct 31 08:03:33.183917 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.183896 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\") pod \"759ba15b-c3f0-498c-a89c-707df8f57a57\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " Oct 31 08:03:33.184037 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.183959 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\" (UniqueName: \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\") pod \"759ba15b-c3f0-498c-a89c-707df8f57a57\" (UID: \"759ba15b-c3f0-498c-a89c-707df8f57a57\") " Oct 31 08:03:33.184290 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.184267 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume" pod "759ba15b-c3f0-498c-a89c-707df8f57a57" (UID: "759ba15b-c3f0-498c-a89c-707df8f57a57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:03:33.185919 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.185898 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q" pod "759ba15b-c3f0-498c-a89c-707df8f57a57" (UID: "759ba15b-c3f0-498c-a89c-707df8f57a57"). InnerVolumeSpecName "kube-api-access-8nt8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:03:33.285238 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.285204 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nt8q\" (UniqueName: \"kubernetes.io/projected/759ba15b-c3f0-498c-a89c-707df8f57a57-kube-api-access-8nt8q\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:33.285238 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.285233 4406 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/759ba15b-c3f0-498c-a89c-707df8f57a57-plugins-config-volume\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:03:33.476537 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.476503 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:03:33.486918 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:33.486892 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fd18eeb3-9c8ccbf7f-6w9w5"] Oct 31 08:03:35.475399 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:03:35.475361 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="759ba15b-c3f0-498c-a89c-707df8f57a57" path="/var/lib/kubelet/pods/759ba15b-c3f0-498c-a89c-707df8f57a57/volumes" Oct 31 08:03:39.990198 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:03:39.990163 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:04:09.991099 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:04:09.991063 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:04:10.028197 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028172 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:04:10.028533 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028520 4406 cpu_manager.go:414] "containerMap: removing container" podUID="759ba15b-c3f0-498c-a89c-707df8f57a57" containerName="payload-pre-processing" Oct 31 08:04:10.028577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028535 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="759ba15b-c3f0-498c-a89c-707df8f57a57" containerName="payload-pre-processing" Oct 31 08:04:10.028577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028546 4406 cpu_manager.go:414] "containerMap: removing container" podUID="66c43ba7-7c41-4b62-a311-b869a0908d33" containerName="maas-api" Oct 31 08:04:10.028577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028552 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66c43ba7-7c41-4b62-a311-b869a0908d33" containerName="maas-api" Oct 31 08:04:10.028679 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028629 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="759ba15b-c3f0-498c-a89c-707df8f57a57" containerName="payload-pre-processing" Oct 31 08:04:10.028679 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.028637 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="66c43ba7-7c41-4b62-a311-b869a0908d33" containerName="maas-api" Oct 31 08:04:10.031353 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.031338 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.055440 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.055420 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-0503df-serving-cert\"" Oct 31 08:04:10.078223 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.078199 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:04:10.121133 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.121097 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9spqj\" (UniqueName: \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.121289 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.121188 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.121289 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.121272 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.121381 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.121350 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.222718 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.222689 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9spqj\" (UniqueName: \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.222868 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.222739 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.222868 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.222807 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.222951 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.222869 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.223571 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.223541 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.225237 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.225213 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.225478 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.225459 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.240895 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.240859 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9spqj\" (UniqueName: \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\") pod \"maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.343721 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.343692 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:10.640355 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:10.640128 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:04:10.643870 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:04:10.643833 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057090a8_da86_4083_a93e_2815e2ffd1a9.slice/crio-5666ec6295fce74deb8eb60ea751962b1cb6e08b95ad43cec4fab68d870a3520 WatchSource:0}: Error finding container 5666ec6295fce74deb8eb60ea751962b1cb6e08b95ad43cec4fab68d870a3520: Status 404 returned error can't find the container with id 5666ec6295fce74deb8eb60ea751962b1cb6e08b95ad43cec4fab68d870a3520 Oct 31 08:04:11.293176 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:11.293140 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" event={"ID":"057090a8-da86-4083-a93e-2815e2ffd1a9","Type":"ContainerStarted","Data":"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24"} Oct 31 08:04:11.293656 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:11.293195 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" event={"ID":"057090a8-da86-4083-a93e-2815e2ffd1a9","Type":"ContainerStarted","Data":"5666ec6295fce74deb8eb60ea751962b1cb6e08b95ad43cec4fab68d870a3520"} Oct 31 08:04:11.293656 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:11.293229 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:11.331977 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:11.331929 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" podStartSLOduration=1.883675405 podStartE2EDuration="2.331915813s" totalImagesPullingTime="448.240408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:04:11.33123308 +0000 UTC m=+2157.978232372" watchObservedRunningTime="2026-10-31 08:04:11.331915813 +0000 UTC m=+2157.978915092" Oct 31 08:04:17.303390 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:04:17.303363 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:04:39.991173 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:04:39.991130 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:05:09.992117 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:05:09.992030 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:05:39.991768 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:05:39.991723 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:05:59.922776 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:05:59.922736 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:05:59.923322 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:05:59.923011 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" podUID="057090a8-da86-4083-a93e-2815e2ffd1a9" containerName="maas-api" containerID="cri-o://fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24" gracePeriod=30 Oct 31 08:06:00.209928 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.209901 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:06:00.312752 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.312721 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\") pod \"057090a8-da86-4083-a93e-2815e2ffd1a9\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " Oct 31 08:06:00.312960 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.312777 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\") pod \"057090a8-da86-4083-a93e-2815e2ffd1a9\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " Oct 31 08:06:00.312960 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.312847 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\" (UniqueName: \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\") pod \"057090a8-da86-4083-a93e-2815e2ffd1a9\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " Oct 31 08:06:00.312960 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.312898 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\") pod \"057090a8-da86-4083-a93e-2815e2ffd1a9\" (UID: \"057090a8-da86-4083-a93e-2815e2ffd1a9\") " Oct 31 08:06:00.313545 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.313517 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca" pod "057090a8-da86-4083-a93e-2815e2ffd1a9" (UID: "057090a8-da86-4083-a93e-2815e2ffd1a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:06:00.314995 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.314965 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls" pod "057090a8-da86-4083-a93e-2815e2ffd1a9" (UID: "057090a8-da86-4083-a93e-2815e2ffd1a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:06:00.315100 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.315040 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj" pod "057090a8-da86-4083-a93e-2815e2ffd1a9" (UID: "057090a8-da86-4083-a93e-2815e2ffd1a9"). InnerVolumeSpecName "kube-api-access-9spqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:06:00.315100 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.315084 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs" pod "057090a8-da86-4083-a93e-2815e2ffd1a9" (UID: "057090a8-da86-4083-a93e-2815e2ffd1a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 08:06:00.414242 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.414204 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9spqj\" (UniqueName: \"kubernetes.io/projected/057090a8-da86-4083-a93e-2815e2ffd1a9-kube-api-access-9spqj\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:06:00.414242 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.414236 4406 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057090a8-da86-4083-a93e-2815e2ffd1a9-openshift-service-ca\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:06:00.414242 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.414261 4406 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-metrics-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:06:00.414242 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.414270 4406 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057090a8-da86-4083-a93e-2815e2ffd1a9-maas-api-tls\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:06:00.800958 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.800925 4406 generic.go:356] "Generic (PLEG): container finished" podID="057090a8-da86-4083-a93e-2815e2ffd1a9" containerID="fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24" exitCode=0 Oct 31 08:06:00.801154 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.800972 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" Oct 31 08:06:00.801154 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.801010 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" event={"ID":"057090a8-da86-4083-a93e-2815e2ffd1a9","Type":"ContainerDied","Data":"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24"} Oct 31 08:06:00.801154 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.801068 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb" event={"ID":"057090a8-da86-4083-a93e-2815e2ffd1a9","Type":"ContainerDied","Data":"5666ec6295fce74deb8eb60ea751962b1cb6e08b95ad43cec4fab68d870a3520"} Oct 31 08:06:00.801154 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.801089 4406 scope.go:122] "RemoveContainer" containerID="fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24" Oct 31 08:06:00.810234 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.810209 4406 scope.go:122] "RemoveContainer" containerID="fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24" Oct 31 08:06:00.810529 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:06:00.810511 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24\": container with ID starting with fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24 not found: ID does not exist" containerID="fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24" Oct 31 08:06:00.810599 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.810543 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24"} err="failed to get container status \"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24\": rpc error: code = NotFound desc = could not find container \"fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24\": container with ID starting with fa824b1f22a7745edb9a8774e0d9dfc0f25e4720816ea5f036acc8a485d22c24 not found: ID does not exist" Oct 31 08:06:00.847017 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.846986 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:06:00.857788 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:00.857759 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb"] Oct 31 08:06:01.475733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:06:01.475692 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="057090a8-da86-4083-a93e-2815e2ffd1a9" path="/var/lib/kubelet/pods/057090a8-da86-4083-a93e-2815e2ffd1a9/volumes" Oct 31 08:06:09.990952 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:06:09.990917 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:06:39.991125 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:06:39.991084 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:07:09.992020 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:07:09.991978 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:07:24.013278 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:07:24.010403 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-2r8hh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 08:07:24.013278 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:07:24.010492 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 08:07:24.087407 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:07:24.087357 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-gbzm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 08:07:24.087730 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:07:24.087693 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 08:07:39.992975 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:07:39.992937 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:07:53.317682 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:07:53.317646 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-7jwkr_7ca7c3ef-a391-45dd-adb4-96d708f71e84/manager/0.log" Oct 31 08:08:03.783997 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:03.783908 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:08:04.591966 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:04.591935 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-mqt5h_85165338-eb50-4bdd-b164-85266fbe1c33/proxy/0.log" Oct 31 08:08:05.519245 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:05.519213 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f4d8b9659-rbhwr_0a615321-5cfd-4712-ac2f-470c6b1f0e59/maas-api/0.log" Oct 31 08:08:09.991548 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:08:09.991504 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:08:18.502378 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:18.502313 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-58c8v_bcd5f1b7-ae22-42d6-84b0-0833aa31aae9/manager/0.log" Oct 31 08:08:29.921360 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:29.921323 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwpcc_dd30ea5d-8d7b-4094-b299-3df6a300a172/discovery/0.log" Oct 31 08:08:30.132485 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:30.132452 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdbcb4849-rxmkb_b923d6a1-f8b9-41de-848c-f8f44cd866c0/kube-auth-proxy/0.log" Oct 31 08:08:30.491865 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:30.491829 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-2r8hh_ca259464-bb5e-43be-833d-3d7d5e9e45ea/istio-proxy/0.log" Oct 31 08:08:30.701352 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:30.701318 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-6g544_c781af22-f657-4feb-b561-ea999019ba26/istio-proxy/0.log" Oct 31 08:08:30.906266 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:30.906217 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-gbzm6_8c5252cc-f747-4421-ac45-ce3ff36e6b0c/istio-proxy/0.log" Oct 31 08:08:31.296741 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:31.296647 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-lq99r_36384417-7e09-4b91-b76f-6ead111f67d6/istio-proxy/0.log" Oct 31 08:08:33.927288 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:33.927243 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd_462d933b-e164-4df9-aa16-391c4a96899c/main/0.log" Oct 31 08:08:34.120639 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:34.120611 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9hnvj_7a8e0cf5-c25b-413d-b432-dec2128252a6/main/0.log" Oct 31 08:08:34.496312 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:34.496275 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-gvj27_f9980644-f455-478c-9d58-7e02ea1e1ae0/main/0.log" Oct 31 08:08:34.691905 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:08:34.691874 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw_97a67a77-654f-4689-91ce-f622fb1ca988/main/0.log" Oct 31 08:08:39.991444 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:08:39.991383 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:09:09.990740 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:09:09.990699 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:09:15.509613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:15.509572 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-7jwkr_7ca7c3ef-a391-45dd-adb4-96d708f71e84/manager/0.log" Oct 31 08:09:25.984734 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:25.984702 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:09:26.630537 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:26.630508 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-mqt5h_85165338-eb50-4bdd-b164-85266fbe1c33/proxy/0.log" Oct 31 08:09:27.344924 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:27.344888 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f4d8b9659-rbhwr_0a615321-5cfd-4712-ac2f-470c6b1f0e59/maas-api/0.log" Oct 31 08:09:39.991083 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:09:39.991040 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:09:40.031958 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:40.031923 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-58c8v_bcd5f1b7-ae22-42d6-84b0-0833aa31aae9/manager/0.log" Oct 31 08:09:41.187862 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:41.187829 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwpcc_dd30ea5d-8d7b-4094-b299-3df6a300a172/discovery/0.log" Oct 31 08:09:41.393451 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:41.393418 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdbcb4849-rxmkb_b923d6a1-f8b9-41de-848c-f8f44cd866c0/kube-auth-proxy/0.log" Oct 31 08:09:41.752491 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:41.752464 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-2r8hh_ca259464-bb5e-43be-833d-3d7d5e9e45ea/istio-proxy/0.log" Oct 31 08:09:41.937470 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:41.937442 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-6g544_c781af22-f657-4feb-b561-ea999019ba26/istio-proxy/0.log" Oct 31 08:09:42.118189 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:42.118158 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-gbzm6_8c5252cc-f747-4421-ac45-ce3ff36e6b0c/istio-proxy/0.log" Oct 31 08:09:42.503731 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:42.503624 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-lq99r_36384417-7e09-4b91-b76f-6ead111f67d6/istio-proxy/0.log" Oct 31 08:09:44.666842 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:44.666816 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-znxbd_462d933b-e164-4df9-aa16-391c4a96899c/main/0.log" Oct 31 08:09:44.850735 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:44.850705 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9hnvj_7a8e0cf5-c25b-413d-b432-dec2128252a6/main/0.log" Oct 31 08:09:45.269661 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:45.269628 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-gvj27_f9980644-f455-478c-9d58-7e02ea1e1ae0/main/0.log" Oct 31 08:09:45.453588 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:09:45.453553 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m58zw_97a67a77-654f-4689-91ce-f622fb1ca988/main/0.log" Oct 31 08:10:09.991787 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:10:09.991747 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:10:39.992498 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:10:39.992457 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:11:09.991523 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:11:09.991439 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:11:39.990349 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:11:39.990309 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:11:42.917795 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:11:42.917759 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:11:43.179458 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:11:43.179374 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:12:09.990588 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:09.990553 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:12:39.990614 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:39.990571 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:12:46.308642 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.308608 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 08:12:46.309205 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.308868 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" containerID="cri-o://8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66" gracePeriod=30 Oct 31 08:12:46.319519 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.319494 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 08:12:46.319674 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.319655 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" containerID="cri-o://1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c" gracePeriod=30 Oct 31 08:12:46.320835 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.320810 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 08:12:46.321009 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.320975 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" containerID="cri-o://7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5" gracePeriod=30 Oct 31 08:12:46.330147 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.330124 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 08:12:46.330338 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:46.330304 4406 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" containerID="cri-o://4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6" gracePeriod=30 Oct 31 08:12:51.446702 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.446653 4406 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-lq99r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Oct 31 08:12:51.447116 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.446738 4406 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Oct 31 08:12:51.583523 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.583473 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 08:12:51.607968 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.607945 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 08:12:51.629759 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.629728 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.629910 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.629776 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.629910 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.629802 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.629910 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.629829 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630100 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630080 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630156 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630123 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630215 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630182 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630215 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630208 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630353 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630324 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630458 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630394 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630458 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630428 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630456 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630536 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630577 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630567 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630598 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630631 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\") pod \"c781af22-f657-4feb-b561-ea999019ba26\" (UID: \"c781af22-f657-4feb-b561-ea999019ba26\") " Oct 31 08:12:51.630733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630664 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.630733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630686 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.630733 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.630697 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\") pod \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\" (UID: \"ca259464-bb5e-43be-833d-3d7d5e9e45ea\") " Oct 31 08:12:51.631108 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.631089 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.631792 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.631603 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.632021 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.631969 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.632377 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632318 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.632377 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632333 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.632567 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632469 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.632706 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632659 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:12:51.632839 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632809 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.633052 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.632957 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.633290 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.633208 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "kube-api-access-l2gd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.633290 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.633265 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:12:51.634018 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.633978 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 08:12:51.634189 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.634164 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 08:12:51.635021 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.634990 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "kube-api-access-szz9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.635672 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.635648 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.637063 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.637039 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.637421 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.637390 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token" pod "c781af22-f657-4feb-b561-ea999019ba26" (UID: "c781af22-f657-4feb-b561-ea999019ba26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.637647 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.637616 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token" pod "ca259464-bb5e-43be-833d-3d7d5e9e45ea" (UID: "ca259464-bb5e-43be-833d-3d7d5e9e45ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.652204 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.652177 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 08:12:51.661340 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.661317 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 08:12:51.679867 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.679839 4406 generic.go:356] "Generic (PLEG): container finished" podID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerID="1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c" exitCode=0 Oct 31 08:12:51.680001 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.679890 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" Oct 31 08:12:51.680001 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.679930 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" event={"ID":"ca259464-bb5e-43be-833d-3d7d5e9e45ea","Type":"ContainerDied","Data":"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c"} Oct 31 08:12:51.680001 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.679987 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh" event={"ID":"ca259464-bb5e-43be-833d-3d7d5e9e45ea","Type":"ContainerDied","Data":"43ab04607826c30e3fb35af96025bc4ceb06ed05c0b315a27f53ad58d1b6db48"} Oct 31 08:12:51.680141 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.680018 4406 scope.go:122] "RemoveContainer" containerID="1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c" Oct 31 08:12:51.681917 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.681777 4406 generic.go:356] "Generic (PLEG): container finished" podID="c781af22-f657-4feb-b561-ea999019ba26" containerID="8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66" exitCode=0 Oct 31 08:12:51.681917 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.681811 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" event={"ID":"c781af22-f657-4feb-b561-ea999019ba26","Type":"ContainerDied","Data":"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66"} Oct 31 08:12:51.681917 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.681832 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" Oct 31 08:12:51.681917 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.681851 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544" event={"ID":"c781af22-f657-4feb-b561-ea999019ba26","Type":"ContainerDied","Data":"708f3e108aaf70401e88de9497d7910060d96ddb0258df0b7cb8b111b816b8bf"} Oct 31 08:12:51.683718 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.683539 4406 generic.go:356] "Generic (PLEG): container finished" podID="36384417-7e09-4b91-b76f-6ead111f67d6" containerID="4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6" exitCode=0 Oct 31 08:12:51.683718 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.683587 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" Oct 31 08:12:51.683718 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.683649 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" event={"ID":"36384417-7e09-4b91-b76f-6ead111f67d6","Type":"ContainerDied","Data":"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6"} Oct 31 08:12:51.683718 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.683687 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r" event={"ID":"36384417-7e09-4b91-b76f-6ead111f67d6","Type":"ContainerDied","Data":"6ee2ea869fd985e31577daf504762f957b596ac80525deb9db4fd2ada2d92e1c"} Oct 31 08:12:51.685304 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.685065 4406 generic.go:356] "Generic (PLEG): container finished" podID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerID="7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5" exitCode=0 Oct 31 08:12:51.685304 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.685098 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" event={"ID":"8c5252cc-f747-4421-ac45-ce3ff36e6b0c","Type":"ContainerDied","Data":"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5"} Oct 31 08:12:51.685304 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.685135 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" event={"ID":"8c5252cc-f747-4421-ac45-ce3ff36e6b0c","Type":"ContainerDied","Data":"c0c9773b48b2fbfd7814ade37e35f4bc308d969f8598623de677d189b63c05a4"} Oct 31 08:12:51.685304 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.685103 4406 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6" Oct 31 08:12:51.691868 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.691847 4406 scope.go:122] "RemoveContainer" containerID="1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c" Oct 31 08:12:51.692314 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:51.692287 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c\": container with ID starting with 1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c not found: ID does not exist" containerID="1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c" Oct 31 08:12:51.692394 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.692328 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c"} err="failed to get container status \"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c\": rpc error: code = NotFound desc = could not find container \"1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c\": container with ID starting with 1ec4cad470c04f026a9efc5c39816bc9e7c95848f4221eeb5cb983077238654c not found: ID does not exist" Oct 31 08:12:51.692394 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.692345 4406 scope.go:122] "RemoveContainer" containerID="8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66" Oct 31 08:12:51.700351 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.700334 4406 scope.go:122] "RemoveContainer" containerID="8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66" Oct 31 08:12:51.700625 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:51.700599 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66\": container with ID starting with 8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66 not found: ID does not exist" containerID="8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66" Oct 31 08:12:51.700693 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.700631 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66"} err="failed to get container status \"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66\": rpc error: code = NotFound desc = could not find container \"8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66\": container with ID starting with 8e5df2ef1c18ad3a650c8287f188f09909059029d66ac0d2bcf393b13d963d66 not found: ID does not exist" Oct 31 08:12:51.700693 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.700646 4406 scope.go:122] "RemoveContainer" containerID="4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6" Oct 31 08:12:51.709151 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.709135 4406 scope.go:122] "RemoveContainer" containerID="4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6" Oct 31 08:12:51.709468 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:51.709451 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6\": container with ID starting with 4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6 not found: ID does not exist" containerID="4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6" Oct 31 08:12:51.709528 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.709475 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6"} err="failed to get container status \"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6\": rpc error: code = NotFound desc = could not find container \"4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6\": container with ID starting with 4586d0ccc40140cf3729cc62c9b4dc3b8f6fbe1e9b5b0d3d4f310290dfb020e6 not found: ID does not exist" Oct 31 08:12:51.709528 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.709493 4406 scope.go:122] "RemoveContainer" containerID="7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5" Oct 31 08:12:51.718097 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.718076 4406 scope.go:122] "RemoveContainer" containerID="7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5" Oct 31 08:12:51.718448 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:12:51.718423 4406 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5\": container with ID starting with 7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5 not found: ID does not exist" containerID="7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5" Oct 31 08:12:51.718546 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.718457 4406 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5"} err="failed to get container status \"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5\": rpc error: code = NotFound desc = could not find container \"7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5\": container with ID starting with 7d5fc581184f24758a96f48ed39328228462a24fec3aa9ddbb821e6c045091d5 not found: ID does not exist" Oct 31 08:12:51.731996 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.731970 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732084 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732006 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732084 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732039 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732195 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732086 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732195 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732123 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732316 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732236 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.732316 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732270 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.732423 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732345 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732423 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732368 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.732423 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732382 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732423 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732418 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732457 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732486 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732524 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732571 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732613 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732596 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732632 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732669 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732724 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732763 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\") pod \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\" (UID: \"8c5252cc-f747-4421-ac45-ce3ff36e6b0c\") " Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732792 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.732876 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.732827 4406 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\") pod \"36384417-7e09-4b91-b76f-6ead111f67d6\" (UID: \"36384417-7e09-4b91-b76f-6ead111f67d6\") " Oct 31 08:12:51.733180 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733119 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.733180 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733149 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733180 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733164 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733180 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733179 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733192 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c781af22-f657-4feb-b561-ea999019ba26-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733207 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733219 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733232 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733287 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szz9s\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-kube-api-access-szz9s\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733301 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733313 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733326 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c781af22-f657-4feb-b561-ea999019ba26-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733340 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733354 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733367 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733378 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733390 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.733402 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733403 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733415 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733430 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca259464-bb5e-43be-833d-3d7d5e9e45ea-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733443 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c781af22-f657-4feb-b561-ea999019ba26-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733449 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733458 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2gd2\" (UniqueName: \"kubernetes.io/projected/c781af22-f657-4feb-b561-ea999019ba26-kube-api-access-l2gd2\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733767 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733776 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733824 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.734085 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.733849 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.734773 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.734749 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "kube-api-access-jpcts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.735083 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.735054 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.736108 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.736058 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 08:12:51.736108 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.736090 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "kube-api-access-8424q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.736108 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.736102 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token" pod "36384417-7e09-4b91-b76f-6ead111f67d6" (UID: "36384417-7e09-4b91-b76f-6ead111f67d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.736386 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.736122 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 08:12:51.736509 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.736493 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 08:12:51.737418 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.737402 4406 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy" pod "8c5252cc-f747-4421-ac45-ce3ff36e6b0c" (UID: "8c5252cc-f747-4421-ac45-ce3ff36e6b0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 08:12:51.781714 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.781688 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 08:12:51.783547 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.783527 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-6g544"] Oct 31 08:12:51.825974 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.825949 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 08:12:51.829269 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.829236 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-2r8hh"] Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834106 4406 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834128 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834137 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8424q\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-kube-api-access-8424q\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834146 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834154 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834160 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834161 4406 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-token\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834169 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36384417-7e09-4b91-b76f-6ead111f67d6-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834177 4406 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-data\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834185 4406 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpcts\" (UniqueName: \"kubernetes.io/projected/36384417-7e09-4b91-b76f-6ead111f67d6-kube-api-access-jpcts\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834192 4406 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-credential-socket\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834200 4406 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36384417-7e09-4b91-b76f-6ead111f67d6-istiod-ca-cert\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834207 4406 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-istio-envoy\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834222 4406 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36384417-7e09-4b91-b76f-6ead111f67d6-workload-certs\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:51.834401 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:51.834231 4406 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c5252cc-f747-4421-ac45-ce3ff36e6b0c-istio-podinfo\") on node \"ip-10-0-136-217.ec2.internal\" DevicePath \"\"" Oct 31 08:12:52.026349 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:52.025734 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 08:12:52.030866 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:52.030841 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-lq99r"] Oct 31 08:12:52.061170 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:52.061148 4406 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 08:12:52.065443 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:52.065424 4406 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-gbzm6"] Oct 31 08:12:53.474924 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:53.474895 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" path="/var/lib/kubelet/pods/36384417-7e09-4b91-b76f-6ead111f67d6/volumes" Oct 31 08:12:53.475336 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:53.475323 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" path="/var/lib/kubelet/pods/8c5252cc-f747-4421-ac45-ce3ff36e6b0c/volumes" Oct 31 08:12:53.475705 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:53.475694 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c781af22-f657-4feb-b561-ea999019ba26" path="/var/lib/kubelet/pods/c781af22-f657-4feb-b561-ea999019ba26/volumes" Oct 31 08:12:53.476395 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:12:53.476381 4406 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" path="/var/lib/kubelet/pods/ca259464-bb5e-43be-833d-3d7d5e9e45ea/volumes" Oct 31 08:13:09.990797 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:13:09.990750 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:13:39.990570 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:13:39.990532 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:14:08.997840 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:08.997808 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:14:09.277936 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:09.277860 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:14:09.990306 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:14:09.990275 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:14:10.495023 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.494992 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pl6m9/must-gather-dx8gx"] Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495318 4406 cpu_manager.go:414] "containerMap: removing container" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495329 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495342 4406 cpu_manager.go:414] "containerMap: removing container" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495350 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495366 4406 cpu_manager.go:414] "containerMap: removing container" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495373 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495387 4406 cpu_manager.go:414] "containerMap: removing container" podUID="057090a8-da86-4083-a93e-2815e2ffd1a9" containerName="maas-api" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495391 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="057090a8-da86-4083-a93e-2815e2ffd1a9" containerName="maas-api" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495407 4406 cpu_manager.go:414] "containerMap: removing container" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" Oct 31 08:14:10.495448 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495413 4406 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" Oct 31 08:14:10.495829 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495486 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="c781af22-f657-4feb-b561-ea999019ba26" containerName="istio-proxy" Oct 31 08:14:10.495829 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495501 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca259464-bb5e-43be-833d-3d7d5e9e45ea" containerName="istio-proxy" Oct 31 08:14:10.495829 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495511 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c5252cc-f747-4421-ac45-ce3ff36e6b0c" containerName="istio-proxy" Oct 31 08:14:10.495829 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495518 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="36384417-7e09-4b91-b76f-6ead111f67d6" containerName="istio-proxy" Oct 31 08:14:10.495829 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.495527 4406 memory_manager.go:365] "RemoveStaleState removing state" podUID="057090a8-da86-4083-a93e-2815e2ffd1a9" containerName="maas-api" Oct 31 08:14:10.498606 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.498587 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.513861 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.513844 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pl6m9\"/\"openshift-service-ca.crt\"" Oct 31 08:14:10.525136 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.525110 4406 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pl6m9\"/\"default-dockercfg-gs2j4\"" Oct 31 08:14:10.525344 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.525323 4406 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pl6m9\"/\"kube-root-ca.crt\"" Oct 31 08:14:10.526517 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.526500 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/must-gather-dx8gx"] Oct 31 08:14:10.592719 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.592692 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-must-gather-output\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.592838 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.592758 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjx2p\" (UniqueName: \"kubernetes.io/projected/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-kube-api-access-sjx2p\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.694112 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.694086 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjx2p\" (UniqueName: \"kubernetes.io/projected/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-kube-api-access-sjx2p\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.694215 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.694149 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-must-gather-output\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.694438 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.694423 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-must-gather-output\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.711538 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.711512 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjx2p\" (UniqueName: \"kubernetes.io/projected/1d5a5f07-8fa4-4afa-8b51-c17ecee822ba-kube-api-access-sjx2p\") pod \"must-gather-dx8gx\" (UID: \"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba\") " pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:10.820410 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:10.820354 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" Oct 31 08:14:11.108957 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:11.108929 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/must-gather-dx8gx"] Oct 31 08:14:11.112616 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:14:11.112587 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d5a5f07_8fa4_4afa_8b51_c17ecee822ba.slice/crio-5b4615d1a95b38c7ac432a2eb8ae133c1b4a2eb4c9d36fccb8d7033d9b11ad58 WatchSource:0}: Error finding container 5b4615d1a95b38c7ac432a2eb8ae133c1b4a2eb4c9d36fccb8d7033d9b11ad58: Status 404 returned error can't find the container with id 5b4615d1a95b38c7ac432a2eb8ae133c1b4a2eb4c9d36fccb8d7033d9b11ad58 Oct 31 08:14:11.114438 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:11.114421 4406 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 08:14:12.023284 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:12.020684 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" event={"ID":"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba","Type":"ContainerStarted","Data":"a79e0eac9f4b834e27cdddbae61797d0258300fcf7971bd5b4a2ad793d60d6df"} Oct 31 08:14:12.023284 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:12.020738 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" event={"ID":"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba","Type":"ContainerStarted","Data":"5b4615d1a95b38c7ac432a2eb8ae133c1b4a2eb4c9d36fccb8d7033d9b11ad58"} Oct 31 08:14:13.028467 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:13.028426 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" event={"ID":"1d5a5f07-8fa4-4afa-8b51-c17ecee822ba","Type":"ContainerStarted","Data":"ff421c39431d0d4138dad3e90f7cdbcd69868450c94b4f93254da743558736b2"} Oct 31 08:14:13.065446 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:13.065392 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pl6m9/must-gather-dx8gx" podStartSLOduration=2.331210707 podStartE2EDuration="3.06537577s" totalImagesPullingTime="734.165063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:14:13.064406186 +0000 UTC m=+2759.711405467" watchObservedRunningTime="2026-10-31 08:14:13.06537577 +0000 UTC m=+2759.712375050" Oct 31 08:14:15.109081 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:15.107975 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tptr8_612b66f6-ebbd-40d4-87a9-3ced431e0a0f/global-pull-secret-syncer/0.log" Oct 31 08:14:15.787271 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:15.781446 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nlstp_a77a849d-a548-4916-9c49-ca1aa09594e8/konnectivity-agent/0.log" Oct 31 08:14:16.125272 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:16.124549 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-217.ec2.internal_d3f83b034c7f4b2860ef8c40782c16cd/haproxy/0.log" Oct 31 08:14:22.529873 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:22.529220 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-58c8v_bcd5f1b7-ae22-42d6-84b0-0833aa31aae9/manager/0.log" Oct 31 08:14:23.937317 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:23.937284 4406 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55"] Oct 31 08:14:23.943460 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:23.943431 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:23.964202 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:23.964168 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55"] Oct 31 08:14:24.041441 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.041300 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-proc\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.041441 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.041363 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnmgw\" (UniqueName: \"kubernetes.io/projected/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-kube-api-access-cnmgw\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.041441 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.041433 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-lib-modules\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.041767 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.041513 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-podres\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.041767 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.041616 4406 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-sys\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.145839 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145788 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-podres\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.145839 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145840 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-sys\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145904 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-proc\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145929 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnmgw\" (UniqueName: \"kubernetes.io/projected/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-kube-api-access-cnmgw\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145927 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-podres\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.145958 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-sys\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.146008 4406 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-lib-modules\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.146016 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-proc\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.146310 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.146102 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-lib-modules\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.163193 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.163167 4406 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnmgw\" (UniqueName: \"kubernetes.io/projected/dd190a58-c3c4-4e46-9c2c-9be8e7da5d52-kube-api-access-cnmgw\") pod \"perf-node-gather-daemonset-9bz55\" (UID: \"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.260596 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.260512 4406 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:24.566013 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:24.565933 4406 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55"] Oct 31 08:14:24.569649 ip-10-0-136-217 kubenswrapper[4406]: W1031 08:14:24.569609 4406 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd190a58_c3c4_4e46_9c2c_9be8e7da5d52.slice/crio-31577564560a915ae25a77934f7d4c53e0827e3c1e5803edf2290f7e191e0da4 WatchSource:0}: Error finding container 31577564560a915ae25a77934f7d4c53e0827e3c1e5803edf2290f7e191e0da4: Status 404 returned error can't find the container with id 31577564560a915ae25a77934f7d4c53e0827e3c1e5803edf2290f7e191e0da4 Oct 31 08:14:25.112695 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.112652 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" event={"ID":"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52","Type":"ContainerStarted","Data":"5f6187b8bcb63ef8dede6212681b8b32b8d1f366509c0fa96c475497fb33f767"} Oct 31 08:14:25.113103 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.112719 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" event={"ID":"dd190a58-c3c4-4e46-9c2c-9be8e7da5d52","Type":"ContainerStarted","Data":"31577564560a915ae25a77934f7d4c53e0827e3c1e5803edf2290f7e191e0da4"} Oct 31 08:14:25.113103 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.112841 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:25.494310 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.494221 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsfxh_8cc1705e-fa3a-4172-b17f-5c639e1e0750/node-exporter/0.log" Oct 31 08:14:25.600913 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.600887 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsfxh_8cc1705e-fa3a-4172-b17f-5c639e1e0750/kube-rbac-proxy/0.log" Oct 31 08:14:25.706696 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:25.706670 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsfxh_8cc1705e-fa3a-4172-b17f-5c639e1e0750/init-textfile/0.log" Oct 31 08:14:27.533378 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:27.533343 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-nsqzt_4edbde3c-4ca2-44e0-b3e3-ef165080af7b/prometheus-operator/0.log" Oct 31 08:14:27.636842 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:27.636801 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-nsqzt_4edbde3c-4ca2-44e0-b3e3-ef165080af7b/kube-rbac-proxy/0.log" Oct 31 08:14:27.746415 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:27.746381 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-wxdvz_858461ce-b703-4ee4-be5e-da0a29027cea/prometheus-operator-admission-webhook/0.log" Oct 31 08:14:31.128478 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:31.128443 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" Oct 31 08:14:31.168061 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:31.167341 4406 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-9bz55" podStartSLOduration=8.167322312 podStartE2EDuration="8.167322312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 08:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:14:25.14841707 +0000 UTC m=+2771.795416350" watchObservedRunningTime="2026-10-31 08:14:31.167322312 +0000 UTC m=+2777.814321596" Oct 31 08:14:31.907962 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:31.907934 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7867f5f669-j4fzd_b8f6c3f4-450b-48ec-81c3-311eafd511eb/console/0.log" Oct 31 08:14:32.027766 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:32.027734 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-knhh4_36e89714-ed52-4add-b9d8-d52e2ac79a73/download-server/0.log" Oct 31 08:14:35.291164 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:35.291141 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zg4dd_c8bc87b9-b553-4c62-aa5b-6af07efc5981/dns/0.log" Oct 31 08:14:35.395810 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:35.395770 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zg4dd_c8bc87b9-b553-4c62-aa5b-6af07efc5981/kube-rbac-proxy/0.log" Oct 31 08:14:35.502645 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:35.502622 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffhvf_fcca29ae-118f-4d8e-9dca-47c6f152f234/dns-node-resolver/0.log" Oct 31 08:14:36.695562 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:36.695533 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67c5b95dcd-hv8rg_e0fca3de-a6fb-4872-a908-304b0fb69f54/registry/0.log" Oct 31 08:14:36.930809 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:36.930779 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6ltq_c115d685-21cd-4266-b6ee-49277e579096/node-ca/0.log" Oct 31 08:14:39.912143 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:39.912109 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwpcc_dd30ea5d-8d7b-4094-b299-3df6a300a172/discovery/0.log" Oct 31 08:14:39.991845 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:14:39.991813 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:14:39.994487 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:39.994466 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdbcb4849-rxmkb_b923d6a1-f8b9-41de-848c-f8f44cd866c0/kube-auth-proxy/0.log" Oct 31 08:14:42.166874 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:42.166837 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j44wt_ce8180e3-53b2-4450-95bb-18d2ce088331/serve-healthcheck-canary/0.log" Oct 31 08:14:43.938325 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:43.938297 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzznn_eaa469ee-3e63-4a7e-b745-3981413f85bf/kube-rbac-proxy/0.log" Oct 31 08:14:44.044075 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:44.044040 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzznn_eaa469ee-3e63-4a7e-b745-3981413f85bf/exporter/0.log" Oct 31 08:14:44.152090 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:44.152043 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzznn_eaa469ee-3e63-4a7e-b745-3981413f85bf/extractor/0.log" Oct 31 08:14:44.211956 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:44.211879 4406 generic.go:356] "Generic (PLEG): container finished" podID="719819eb-bfdd-44dc-a074-de9cad90649c" containerID="c25942e0d4e924e83b38d13b78f75fba33f2aff6739fbaa4d6128f3e30c9e015" exitCode=1 Oct 31 08:14:44.211956 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:44.211942 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerDied","Data":"c25942e0d4e924e83b38d13b78f75fba33f2aff6739fbaa4d6128f3e30c9e015"} Oct 31 08:14:44.212319 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:44.212305 4406 scope.go:122] "RemoveContainer" containerID="c25942e0d4e924e83b38d13b78f75fba33f2aff6739fbaa4d6128f3e30c9e015" Oct 31 08:14:45.223404 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:45.222462 4406 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" event={"ID":"719819eb-bfdd-44dc-a074-de9cad90649c","Type":"ContainerStarted","Data":"b0a489ae2a96f3ff0570dbf55770d0a05de5229cf4981a58ab39d7b9bdb724e6"} Oct 31 08:14:45.223404 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:45.223344 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 08:14:47.114797 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:47.114765 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwpcc_dd30ea5d-8d7b-4094-b299-3df6a300a172/discovery/0.log" Oct 31 08:14:47.148193 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:47.148167 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdbcb4849-rxmkb_b923d6a1-f8b9-41de-848c-f8f44cd866c0/kube-auth-proxy/0.log" Oct 31 08:14:47.565164 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:47.565100 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-jlzvj_719819eb-bfdd-44dc-a074-de9cad90649c/manager/1.log" Oct 31 08:14:47.587635 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:47.587602 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-jlzvj_719819eb-bfdd-44dc-a074-de9cad90649c/manager/0.log" Oct 31 08:14:47.715074 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:47.715050 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-jlzvj_719819eb-bfdd-44dc-a074-de9cad90649c/copy-manifests/0.log" Oct 31 08:14:51.168727 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:51.168685 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-7jwkr_7ca7c3ef-a391-45dd-adb4-96d708f71e84/manager/0.log" Oct 31 08:14:51.664397 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:51.664366 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f6b9497b-5ln9b_7c787a1a-1f51-4225-a4d8-477c8d7cbf0f/manager/0.log" Oct 31 08:14:51.862491 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:51.862454 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-mqt5h_85165338-eb50-4bdd-b164-85266fbe1c33/proxy/0.log" Oct 31 08:14:56.237585 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:14:56.237553 4406 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-jlzvj" Oct 31 08:15:04.431115 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.431089 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/kube-multus-additional-cni-plugins/0.log" Oct 31 08:15:04.536268 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.536222 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/egress-router-binary-copy/0.log" Oct 31 08:15:04.643140 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.643116 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/cni-plugins/0.log" Oct 31 08:15:04.753141 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.753084 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/bond-cni-plugin/0.log" Oct 31 08:15:04.860593 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.860569 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/routeoverride-cni/0.log" Oct 31 08:15:04.966463 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:04.966437 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/whereabouts-cni-bincopy/0.log" Oct 31 08:15:05.074364 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:05.074301 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxnxp_12a7b750-341e-40b7-a425-5a452187e803/whereabouts-cni/0.log" Oct 31 08:15:05.331930 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:05.331903 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qgqtb_20df0d97-58e7-42de-a1c0-e195bc62abca/kube-multus/0.log" Oct 31 08:15:05.634841 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:05.634767 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn94r_a3001ced-ad94-48ad-b282-06a2a531606c/network-metrics-daemon/0.log" Oct 31 08:15:05.737631 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:05.737606 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn94r_a3001ced-ad94-48ad-b282-06a2a531606c/kube-rbac-proxy/0.log" Oct 31 08:15:09.364985 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.364957 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/ovn-controller/0.log" Oct 31 08:15:09.468732 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.468708 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/ovn-acl-logging/0.log" Oct 31 08:15:09.574867 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.574837 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/kube-rbac-proxy-node/0.log" Oct 31 08:15:09.685356 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.685270 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/kube-rbac-proxy-ovn-metrics/0.log" Oct 31 08:15:09.793652 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.793631 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/northd/0.log" Oct 31 08:15:09.898476 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:09.898449 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/nbdb/0.log" Oct 31 08:15:09.990906 ip-10-0-136-217 kubenswrapper[4406]: E1031 08:15:09.990836 4406 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zzznn" containerName="extractor" Oct 31 08:15:10.005118 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:10.005094 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/sbdb/0.log" Oct 31 08:15:10.198926 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:10.198884 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p9l6j_9374723a-d550-4425-9fb9-380fd3784945/ovnkube-controller/0.log" Oct 31 08:15:11.388357 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:11.388303 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-mwpcc_dd30ea5d-8d7b-4094-b299-3df6a300a172/discovery/0.log" Oct 31 08:15:11.439841 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:11.439778 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdbcb4849-rxmkb_b923d6a1-f8b9-41de-848c-f8f44cd866c0/kube-auth-proxy/0.log" Oct 31 08:15:12.657406 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:12.657372 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2gtzn_21a6f12f-fda5-4424-9e56-6a0ca7387aaf/network-check-target-container/0.log" Oct 31 08:15:15.139099 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:15.139070 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-86hqz_8697ef31-6a1d-4d75-a5a8-2d715991cfef/iptables-alerter/0.log" Oct 31 08:15:16.988367 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:16.988334 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wjqj5_5c2a96ac-7c93-474c-a4ad-9b0091d95209/tuned/0.log" Oct 31 08:15:24.654066 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:24.654037 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-86xw5_5312dbea-fea7-4156-9f54-594964546777/csi-driver/0.log" Oct 31 08:15:24.758912 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:24.758886 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-86xw5_5312dbea-fea7-4156-9f54-594964546777/csi-node-driver-registrar/0.log" Oct 31 08:15:24.862686 ip-10-0-136-217 kubenswrapper[4406]: I1031 08:15:24.862658 4406 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-86xw5_5312dbea-fea7-4156-9f54-594964546777/csi-liveness-probe/0.log"