Oct 30 20:38:15.717804 ip-10-0-135-104 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:16.091557 ip-10-0-135-104 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:16.091557 ip-10-0-135-104 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:16.091557 ip-10-0-135-104 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:16.091557 ip-10-0-135-104 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:16.094781 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094688    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.094781 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094779    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.094781 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094784    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094787    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094791    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094800    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094804    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094807    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094810    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094813    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094816    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094819    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094822    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094824    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094835    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094839    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094841    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094844    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094847    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094850    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094853    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094855    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.094884 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094858    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094860    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094863    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094865    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094868    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094881    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094884    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094888    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094891    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094894    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094897    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094900    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094902    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094905    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094907    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094910    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094912    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094915    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094917    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.095345 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094920    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094923    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094925    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094928    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094930    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094933    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094935    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094944    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094946    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094950    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094952    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094954    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094957    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094959    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094962    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094966    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094968    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094971    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094973    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094976    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.095897 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094978    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094981    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094984    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094986    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094989    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094991    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094994    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094996    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.094999    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095001    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095004    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095007    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095009    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095012    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095014    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095017    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095020    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095023    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095025    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095028    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.096368 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095038    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095043    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095046    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095048    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095051    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095053    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095056    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095060    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095063    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095065    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095069    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095073    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095077    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095080    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095083    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095085    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095088    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095090    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.096855 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095093    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095096    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095098    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095101    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095103    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095107    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095110    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095964    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095971    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095974    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095976    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095979    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095981    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095984    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095987    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095991    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095993    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095996    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.095999    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.097304 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096001    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096005    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096009    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096011    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096014    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096017    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096019    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096022    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096025    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096029    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096033    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096036    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096039    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096042    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096045    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096048    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096051    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096053    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096056    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.097766 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096058    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096061    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096063    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096066    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096068    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096071    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096073    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096076    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096078    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096081    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096083    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096086    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096089    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096092    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096094    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096097    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096100    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096103    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096105    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096108    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.098214 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096111    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096113    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096116    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096118    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096121    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096123    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096126    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096128    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096131    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096134    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096136    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096145    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096147    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096150    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096153    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096155    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096158    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096160    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096163    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096166    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.098704 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096169    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096172    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096176    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096180    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096183    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096186    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096189    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096192    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096194    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096197    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096200    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096202    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096205    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096208    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096210    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096213    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096215    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096218    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096221    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.099183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096224    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096226    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096229    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096231    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096234    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096237    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096239    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096241    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096244    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096247    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096250    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096252    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096255    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096258    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096260    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.096263    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097492    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097499    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097502    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097504    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.099649 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097507    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097510    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097513    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097515    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097518    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097520    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097537    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097540    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097543    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097546    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097549    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097552    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097555    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097557    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097560    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097562    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097565    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097568    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097570    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.100126 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097573    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097575    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097578    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097581    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097583    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097587    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097589    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097592    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097595    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097597    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097600    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097603    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097606    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097608    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097611    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097613    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097616    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097618    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097621    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097624    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.100589 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097627    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097629    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097632    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097635    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097638    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097640    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097643    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097645    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097648    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097651    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097654    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097656    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097659    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097661    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097663    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097667    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097671    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097674    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097676    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097679    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.101070 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097682    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097685    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097687    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097690    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097693    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097696    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097698    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097701    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097703    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097708    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097712    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097715    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097718    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097721    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097723    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097726    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097728    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097731    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097733    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.101567 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097735    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097738    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097741    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097743    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097746    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097749    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097751    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097754    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097756    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097758    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097761    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097763    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097766    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097769    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097771    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097774    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097777    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097780    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097783    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.102009 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097785    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097788    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097790    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097794    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.097797    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097883    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097891    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097897    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097902    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097907    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097910    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097915    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097919    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097922    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097925    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097929    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097932    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097935    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097938    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097942    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097945    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097948    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097951    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:16.102442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097956    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097959    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097962    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097965    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097969    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097973    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097976    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097979    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097985    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097988    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097991    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097994    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.097997    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098001    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098005    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098008    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098012    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098015    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098018    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098022    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098026    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098029    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098033    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098036    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:16.103015 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098039    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098044    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098047    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098050    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098053    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098056    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098059    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098062    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098065    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098068    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098072    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098075    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098079    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098082    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098086    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098089    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098092    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098096    2577 flags.go:64] FLAG: --help="false"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098099    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098103    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098106    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098111    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098115    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:16.103620 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098119    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098122    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098125    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098128    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098130    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098133    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098136    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098141    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098144    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098147    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098150    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098153    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098156    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098159    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098162    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098165    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098171    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098174    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098177    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098180    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098183    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098187    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098189    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098192    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098197    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:16.104161 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098200    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098204    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098208    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098211    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098214    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098219    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098222    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098225    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098229    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098236    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098239    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098242    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098246    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098249    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098253    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098256    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098259    2577 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098262    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098265    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0aeb67e388644be10"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098268    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098272    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098275    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098278    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098282    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098285    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098288    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:16.104948 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098290    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098295    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098298    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098301    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098304    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098308    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098311    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098314    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098317    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098325    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098328    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098334    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098337    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098341    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098344    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098347    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098350    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098353    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098356    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098359    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098363    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098369    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098372    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098375    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098378    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:16.105618 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098381    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098384    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098387    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098390    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098393    2577 flags.go:64] FLAG: --v="2"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098403    2577 flags.go:64] FLAG: --version="false"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098408    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098412    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098415    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098559    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098563    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098566    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098568    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098571    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098574    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098576    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098579    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098583    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098587    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098589    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098592    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.106502 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098595    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098597    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098601    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098605    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098608    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098611    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098615    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098618    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098620    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098623    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098626    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098628    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098631    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098635    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098639    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098642    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098645    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098647    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098650    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.107260 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098652    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098655    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098658    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098660    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098663    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098665    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098668    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098670    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098673    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098675    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098680    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098683    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098685    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098688    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098691    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098693    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098696    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098698    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098701    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.107730 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098704    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098707    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098710    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098713    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098716    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098718    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098721    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098724    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098726    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098729    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098732    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098734    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098737    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098739    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098742    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098744    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098747    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098749    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098752    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098754    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.108183 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098757    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098759    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098762    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098766    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098769    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098772    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098774    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098777    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098779    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098782    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098785    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098787    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098791    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098800    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098805    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098807    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098810    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098812    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098815    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098818    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.108677 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098820    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098823    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098825    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098828    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098830    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098833    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098836    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098838    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098841    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098844    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098846    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098849    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098851    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098854    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098856    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.109153 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098860    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.098886    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098924    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098928    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098932    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098935    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098938    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098940    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098943    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098947    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098950    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098952    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098955    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098957    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098960    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098963    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.109537 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098965    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098968    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098971    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098973    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098976    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098978    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098981    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098983    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098986    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098988    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098991    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098993    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098996    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.098999    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099001    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099004    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099006    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099010    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099014    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.109921 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099018    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099022    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099025    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099028    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099031    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099033    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099037    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099039    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099042    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099045    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099047    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099069    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099094    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099099    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099102    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099105    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099109    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099112    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099115    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.110376 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099118    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099120    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099123    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099126    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099129    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099132    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099134    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099137    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099140    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099142    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099145    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099148    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099150    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099153    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099156    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099158    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099161    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099164    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099166    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.110841 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099169    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099171    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099174    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099177    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099181    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099184    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099187    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099191    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099194    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099197    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099200    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099203    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099206    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099208    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099211    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099214    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099216    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099219    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099222    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099224    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.111326 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099227    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099230    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099232    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099235    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099238    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099241    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099244    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099247    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099250    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099252    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099255    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099258    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099263    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099266    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.099268    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108040    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108060    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108083    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108090    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108151    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.111819 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108156    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108159    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108162    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108165    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108168    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108171    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108174    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108178    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108182    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108186    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108189    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108191    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108195    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108198    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108201    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108203    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108206    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108208    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108211    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.112290 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108214    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108217    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108220    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108223    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108225    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108228    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108231    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108234    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108237    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108239    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108242    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108245    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108248    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108251    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108253    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108256    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108259    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108261    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108264    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108266    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.112790 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108269    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108272    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108275    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108278    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108280    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108283    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108285    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108288    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108290    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108293    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108295    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108298    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108301    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108303    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108306    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108309    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108311    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108314    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108317    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.113259 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108319    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108322    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108324    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108327    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108330    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108333    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108335    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108338    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108340    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108344    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108346    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108349    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108352    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108354    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108357    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108359    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108362    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108365    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108367    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108371    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.113732 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108381    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108383    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108386    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108389    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108392    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108394    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108397    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108399    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108402    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108405    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108408    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108410    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108413    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108415    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108418    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108420    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108423    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108426    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108428    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108431    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.114197 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108433    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108436    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108438    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108441    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108443    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108446    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108448    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108481    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108646    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108651    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108654    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108657    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108659    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108663    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108666    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108668    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.114753 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108671    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108674    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108677    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108681    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108685    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108688    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108691    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108693    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108696    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108699    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108701    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108704    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108707    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108709    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108712    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108715    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108719    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108723    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108726    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.115133 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108729    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108731    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108734    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108736    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108739    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108742    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108744    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108747    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108749    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108752    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108754    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108757    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108760    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108763    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108766    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108768    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108771    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108774    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108776    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108779    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.116174 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108781    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108784    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108786    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108789    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108791    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108794    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108797    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108799    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108802    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108805    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108807    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108809    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108812    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108814    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108817    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108820    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108822    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108825    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108827    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108830    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.116657 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108833    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108835    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108838    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108840    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108846    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108848    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108851    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108854    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108857    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108859    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108862    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108865    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108868    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108870    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108873    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108875    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108878    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108881    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108883    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108886    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.117130 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108888    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108891    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108894    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108899    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108902    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108904    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108907    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108909    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108912    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108914    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108917    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108919    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108922    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108924    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108927    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108929    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108932    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108935    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.117615 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108938    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.108961    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108992    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108996    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.108999    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109002    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109005    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109008    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109010    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109013    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109016    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109018    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109021    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109023    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109026    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109028    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:16.118030 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109031    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109034    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109038    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109041    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109043    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109046    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109048    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109051    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109054    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109056    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109061    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109063    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109066    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109069    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109071    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109074    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109077    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109080    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109082    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109085    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:16.118448 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109088    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109090    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109093    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109095    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109098    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109100    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109103    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109105    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109108    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109110    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109113    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109115    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109118    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109120    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109124    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109127    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109130    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109132    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109134    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:16.118939 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109137    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109139    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109142    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109146    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109149    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109151    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109154    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109156    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109159    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109161    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109166    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109169    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109173    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109176    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109179    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109181    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109184    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109186    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109189    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:16.119379 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109191    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109194    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109197    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109199    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109203    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109207    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109211    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109214    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109218    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109220    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109223    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109225    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109228    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109230    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109233    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109235    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109239    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109242    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109244    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:16.119927 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109247    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109250    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109253    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109255    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109258    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109261    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109264    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109266    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109269    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109271    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109275    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109277    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109280    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109282    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:16.109285    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.109350    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.112100    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.113377    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.113473    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:16.120428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.113519    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:16.121043 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.115348    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:16.121043 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.116552    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:16.125604 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.125570    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:16.128773 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.128758    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:16.129641 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.129615    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:16.132074 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.132053    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 917ce37a-fe24-46be-8ed4-75f345230c41:/dev/nvme0n1p4 ad045db8-ad3c-4088-a124-f3280a342a98:/dev/nvme0n1p3]
Oct 30 20:38:16.132169 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.132074    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:38:16.138548 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.138418    2577 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:16.136392747 +0000 UTC m=+0.307645819 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099878 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a07072e3a366873f07bfac83150d SystemUUID:ec28a070-72e3-a366-873f-07bfac83150d BootID:04b799f7-2846-4ed6-90e8-bcd543d5d202 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:79:75:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:79:75:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:a3:97:d5:38:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:16.138548 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.138547    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:16.138651 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.138632    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:16.141684 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.141660    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:16.142159 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.141694    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-104.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:16.142305 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.142194    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:16.142305 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.142205    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:16.142305 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.142244    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:16.142305 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.142270    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:16.143318 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.143297    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:16.147834 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.147816    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:16.147945 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.147936    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:16.148425 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148417    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:16.148459 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148429    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:16.148459 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148439    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:16.148459 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148448    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:16.148459 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148456    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:16.148965 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.148953    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:16.151206 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.151188    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:16.153436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.153420    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:16.156045 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156033    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:16.156703 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156691    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:16.156749 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156722    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:16.156898 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156886    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:16.156936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156907    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:16.156936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156913    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:16.156936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156919    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:16.156936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156924    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:16.156936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.156930    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:16.157436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157428    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:16.157470 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157438    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:16.157470 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157445    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:16.157470 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157451    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:16.157470 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157460    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:16.157470 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.157468    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:16.158871 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.158861    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:16.158871 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.158870    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:16.162606 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.162583    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-104.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:38:16.162816 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.162802    2577 server.go:1263] "Started kubelet"
Oct 30 20:38:16.162919 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.162892    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:16.162973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.162930    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:16.163019 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.162989    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:16.163740 ip-10-0-135-104 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:16.165422 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.165295    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:16.167076 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.167062    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:16.169100 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.169082    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:38:16.172544 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.172500    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 20:38:16.172738 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.172717    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:16.173049 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.173026    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-104.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 20:38:16.173170 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173157    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:16.173353 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.173331    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.173739 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.172865    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c58fc2f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.162763509 +0000 UTC m=+0.334016582,LastTimestamp:2026-10-30 20:38:16.162763509 +0000 UTC m=+0.334016582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.173883 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173862    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:16.173883 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173863    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:16.174016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173892    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:16.174016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173965    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:16.174016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.173973    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:16.174324 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174308    2577 factory.go:55] Registering systemd factory
Oct 30 20:38:16.174378 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174329    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:16.174574 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174557    2577 factory.go:153] Registering CRI-O factory
Oct 30 20:38:16.174574 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174574    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:16.174715 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174633    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:16.174715 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174651    2577 factory.go:103] Registering Raw factory
Oct 30 20:38:16.174715 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.174665    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:16.176310 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.176290    2577 manager.go:319] Starting recovery of all containers
Oct 30 20:38:16.181962 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.181934    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-104.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:38:16.188689 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.188667    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 20:38:16.190510 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.190493    2577 manager.go:324] Recovery completed
Oct 30 20:38:16.194887 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.194871    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.197086 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197067    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.197152 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197104    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.197152 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197117    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.197768 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197753    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:16.197768 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197766    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.197848 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197766    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:16.197876 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.197852    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:16.198513 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.198496    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.198602 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.198542    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.198602 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.198557    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.199137 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.199064    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79b77fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.19708518 +0000 UTC m=+0.368338260,LastTimestamp:2026-10-30 20:38:16.19708518 +0000 UTC m=+0.368338260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.206295 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.206212    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79bdb5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.197110623 +0000 UTC m=+0.368363697,LastTimestamp:2026-10-30 20:38:16.197110623 +0000 UTC m=+0.368363697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.216164 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.216074    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79c0522  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.197121314 +0000 UTC m=+0.368374386,LastTimestamp:2026-10-30 20:38:16.197121314 +0000 UTC m=+0.368374386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.227185 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.227106    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-104.us-east-2.compute.internal.18e36927c79b77fc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79b77fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.19708518 +0000 UTC m=+0.368338260,LastTimestamp:2026-10-30 20:38:16.198512378 +0000 UTC m=+0.369765456,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.231680 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.231609    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-104.us-east-2.compute.internal.18e36927c79bdb5f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79bdb5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.197110623 +0000 UTC m=+0.368363697,LastTimestamp:2026-10-30 20:38:16.198549635 +0000 UTC m=+0.369802708,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.235274 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.235252    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwv5j"
Oct 30 20:38:16.242701 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.242683    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwv5j"
Oct 30 20:38:16.245290 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.245220    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-104.us-east-2.compute.internal.18e36927c79c0522\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-104.us-east-2.compute.internal.18e36927c79c0522  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-104.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-104.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-104.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:16.197121314 +0000 UTC m=+0.368374386,LastTimestamp:2026-10-30 20:38:16.198562719 +0000 UTC m=+0.369815792,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-104.us-east-2.compute.internal,}"
Oct 30 20:38:16.279856 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.273729    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.338562 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.338534    2577 policy_none.go:50] "Start"
Oct 30 20:38:16.338562 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.338562    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:16.338728 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.338576    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:16.340586 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.340571    2577 policy_none.go:44] "Start"
Oct 30 20:38:16.374674 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.374516    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.381171 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.381134    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:16.382214 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.382191    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:16.383589 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.383570    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:16.383589 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.383591    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:16.383729 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.383609    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:16.383729 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.383645    2577 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:38:16.383997 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.383984    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:16.384471 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.384019    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:16.384471 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384031    2577 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:16.384471 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384312    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:16.384471 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384325    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:16.384471 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384433    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:16.384820 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384614    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:16.384820 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.384624    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:16.385075 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.385042    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:16.385154 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.385103    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.396438 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.396423    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:16.398028 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.398010    2577 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-104.us-east-2.compute.internal\" not found" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.484577 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.484554    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.484706 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.484591    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"]
Oct 30 20:38:16.484706 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.484657    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.485576 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485559    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.485655 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485591    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.485655 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485604    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.485655 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485629    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.485655 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485559    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.485786 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485668    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.485786 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.485680    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.488026 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488014    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.488176 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488162    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.488229 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488208    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.488736 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488720    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.488797 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488744    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.488797 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488759    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.488797 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488783    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.488896 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488801    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.488896 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.488849    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.490843 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.490828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.490923 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.490859    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:16.491681 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.491661    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:16.491746 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.491698    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:16.491746 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.491713    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:16.494678 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.494659    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.494781 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.494684    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-104.us-east-2.compute.internal\": node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.519952 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.519935    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.522708 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.522690    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.554133 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.554106    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.576857 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.576831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.576957 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.576863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.576957 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.576881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.654487 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.654405    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.677787 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.677869 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.677869 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.677869 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677848    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.677869 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677859    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.678006 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.677893    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.754963 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.754914    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.823434 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.823403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.826546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:16.826514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:16.855823 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.855796    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:16.956392 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:16.956313    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.042692 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.042663    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:17.056471 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.056436    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.113429 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.113400    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:38:17.113895 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.113596    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:38:17.113895 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.113596    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:38:17.157176 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.157120    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.258226 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.258110    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.309122 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.309083    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:17.310570 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.310549    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:17.310728 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.310582    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:17.310728 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.310602    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:17.340630 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.340569    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:16 +0000 UTC" deadline="2028-08-09 16:38:26.668961512 +0000 UTC"
Oct 30 20:38:17.340630 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.340622    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15572h0m9.32834309s"
Oct 30 20:38:17.358268 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.358242    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.408720 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.408694    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:17.459036 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.459007    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.515199 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:17.515120    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df339c34627d7b2ef5d4c725a2c41ea.slice/crio-5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e WatchSource:0}: Error finding container 5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e: Status 404 returned error can't find the container with id 5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e
Oct 30 20:38:17.515666 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:17.515642    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab6cd5a3212618f353a61406cc55b55.slice/crio-bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081 WatchSource:0}: Error finding container bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081: Status 404 returned error can't find the container with id bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081
Oct 30 20:38:17.520140 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.520125    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:17.560391 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.560363    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.661288 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:17.661246    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-104.us-east-2.compute.internal\" not found"
Oct 30 20:38:17.732189 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.732153    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:17.774394 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.774320    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:17.793848 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.793827    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:17.795024 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.795011    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:17.803988 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:17.803970    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:18.150263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.150183    2577 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:18.161108 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.161079    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:18.161450 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.161426    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8qztc","openshift-network-diagnostics/network-check-target-85qnr","openshift-cluster-node-tuning-operator/tuned-mzrsz","kube-system/konnectivity-agent-k6rvl","openshift-multus/multus-additional-cni-plugins-nzzx9","openshift-network-operator/iptables-alerter-77clk","openshift-ovn-kubernetes/ovnkube-node-8nd5w","kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj","openshift-dns/node-resolver-mx29f","openshift-image-registry/node-ca-7wb5s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal","openshift-multus/multus-qfbjr","openshift-multus/network-metrics-daemon-knt4f"]
Oct 30 20:38:18.164219 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.164175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.167405 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.167385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.168957 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.168934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.170281 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170262    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:18.170376 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170342    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:18.170483 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170468    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.170544 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170538    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:18.170700 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170683    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hh9qp\""
Oct 30 20:38:18.170782 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.170768    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.171818 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.171785    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:18.172714 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.172685    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:18.172824 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.172717    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.172824 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.172772    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.172824 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.172813    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:18.173010 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.172815    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b7wk5\""
Oct 30 20:38:18.174890 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.174825    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:18.175644 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.175624    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.175823 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.175720    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.175911 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.175896    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g4v6z\""
Oct 30 20:38:18.176017 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.176000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.176723 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.176705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.180420 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.180400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.180587 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.180547    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:18.181559 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.181290    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4khcx\""
Oct 30 20:38:18.181559 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.181323    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:18.181856 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.181835    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kszdw\""
Oct 30 20:38:18.182734 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.182713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.185950 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.185928    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:18.187885 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.187864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.187982 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.187914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.187982 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.187954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.188086 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.187992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.188402 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.188402 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.188402 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.188402 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.188708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdc6n\" (UniqueName: \"kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.188983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk8q2\" (UniqueName: \"kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.189417 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr777\" (UniqueName: \"kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.189766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.189955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lhxf\" (UniqueName: \"kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.190146 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.190579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.190439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.191190 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.191166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.191336 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.191308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.191446 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.191386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.191446 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.191423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.192011 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.191482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.192991 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.192586    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.193206 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.193178    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:18.193650 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.193620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:18.195243 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.195220    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:18.195871 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.195850    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:18.196169 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.196152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.198784 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.198764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.201366 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.201343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.201463 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.201421    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:18.220660 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.220632    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vg7js"
Oct 30 20:38:18.229072 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.229047    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vg7js"
Oct 30 20:38:18.275340 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.275041    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:18.279382 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279351    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w89q8\""
Oct 30 20:38:18.279505 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279480    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7chw8\""
Oct 30 20:38:18.279585 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279569    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.279664 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279649    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:18.279735 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279723    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.279788 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279744    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:18.279788 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279773    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b74p\""
Oct 30 20:38:18.279892 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279820    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:18.279892 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279856    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.279892 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279876    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.280036 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279897    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.280036 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279907    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.280036 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279940    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4gdbd\""
Oct 30 20:38:18.280036 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279972    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:18.280036 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.279974    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:18.280260 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.280160    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:18.292046 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.292179 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.292179 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.292179 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.292179 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292206    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292209    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292249    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292255    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.292385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292578    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292617    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292629    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.292998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdc6n\" (UniqueName: \"kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkhg\" (UniqueName: \"kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.293143 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk8q2\" (UniqueName: \"kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293714    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:18.293863 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.293862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294012    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294053    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294067    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294089    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294135    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294185    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294488    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.294596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294718    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294754    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294769    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294910    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.294970 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr777\" (UniqueName: \"kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.294992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295003    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmkbv\" (UniqueName: \"kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295052    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295086    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295171    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295171    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295224    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295351    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h25v9\" (UniqueName: \"kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.295534 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295511    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295573    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295661    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lhxf\" (UniqueName: \"kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295779    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295848    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.295967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296067    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296262    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.296413 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296292    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296396    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296407    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296468    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296669    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhlls\" (UniqueName: \"kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.297299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296834    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.296958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vdqx\" (UniqueName: \"kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297167    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297200    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297260    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297319    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297345    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297378    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.298695 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297402    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.297712    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.298007    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.298062    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.298423    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.298635    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.299263 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.299037    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.308929 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.308903    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk8q2\" (UniqueName: \"kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.310837 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.310813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lhxf\" (UniqueName: \"kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.310952 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.310846    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdc6n\" (UniqueName: \"kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.312889 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.312869    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr777\" (UniqueName: \"kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.389280 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.389227    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"dab6cd5a3212618f353a61406cc55b55","Type":"ContainerStarted","Data":"bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081"}
Oct 30 20:38:18.390872 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.390712    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerStarted","Data":"5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e"}
Oct 30 20:38:18.397446 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.397623 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.397623 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.397623 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397561    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.397623 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmkbv\" (UniqueName: \"kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.397771 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.397625    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:18.397771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.397771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25v9\" (UniqueName: \"kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.397771 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.397724    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:18.897674901 +0000 UTC m=+3.068927978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397893    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhlls\" (UniqueName: \"kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.397973 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397963    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397963    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdqx\" (UniqueName: \"kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.397984    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398119    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398257    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.398302 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkhg\" (UniqueName: \"kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398427    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398252    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398493    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.398643    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.398697    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:18.898680122 +0000 UTC m=+3.069933205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.398882    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.399050 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.399006    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.414096 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.414019    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:18.414096 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.414056    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:18.414096 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.414070    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:18.414312 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.414134    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:18.914116799 +0000 UTC m=+3.085369884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:18.417483 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.417453    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vdqx\" (UniqueName: \"kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.418014 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.417983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhlls\" (UniqueName: \"kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.418122 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.418034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmkbv\" (UniqueName: \"kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.418771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.418741    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkhg\" (UniqueName: \"kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.418985 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.418964    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25v9\" (UniqueName: \"kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.497639 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.497609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:18.505602 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.505566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:18.508868 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.508725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:18.513766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.513741    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:18.518835 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.518803    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b62c70f_47d9_4521_8e32_e5c65c0c7e87.slice/crio-51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca WatchSource:0}: Error finding container 51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca: Status 404 returned error can't find the container with id 51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca
Oct 30 20:38:18.525554 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.525515    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4b1301_6a55_465f_af3b_6e1113a45271.slice/crio-0d53078fae054d09cd5a81dcaeff92d4b03727a0b80bf9520ae0702d5b43b73c WatchSource:0}: Error finding container 0d53078fae054d09cd5a81dcaeff92d4b03727a0b80bf9520ae0702d5b43b73c: Status 404 returned error can't find the container with id 0d53078fae054d09cd5a81dcaeff92d4b03727a0b80bf9520ae0702d5b43b73c
Oct 30 20:38:18.526383 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.526351    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12625149_ab99_482a_8617_4ef8fe1b541a.slice/crio-0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790 WatchSource:0}: Error finding container 0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790: Status 404 returned error can't find the container with id 0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790
Oct 30 20:38:18.538324 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.538288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:18.539858 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.539834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:18.547766 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.547550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:18.552962 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.552815    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:18.554934 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.554905    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a6b910_20b3_4568_8d1e_b9d0c80b57c5.slice/crio-c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1 WatchSource:0}: Error finding container c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1: Status 404 returned error can't find the container with id c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1
Oct 30 20:38:18.562296 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.561554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:18.564864 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.564802    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5481d1d9_8de8_42b6_bb7b_f9815b9e3f50.slice/crio-9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1 WatchSource:0}: Error finding container 9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1: Status 404 returned error can't find the container with id 9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1
Oct 30 20:38:18.565296 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.565252    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0892a92_0735_4167_b582_537e22ec72c4.slice/crio-b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949 WatchSource:0}: Error finding container b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949: Status 404 returned error can't find the container with id b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949
Oct 30 20:38:18.573763 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:18.573736    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514248b1_0652_4a5a_bc20_74442c71b232.slice/crio-b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054 WatchSource:0}: Error finding container b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054: Status 404 returned error can't find the container with id b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054
Oct 30 20:38:18.690308 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.690219    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:18.901780 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.901746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:18.901950 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.901840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:18.902034 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.901959    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:18.902034 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.902021    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:19.902004827 +0000 UTC m=+4.073257911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:18.902154 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.902074    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:18.902154 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:18.902102    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:19.902091583 +0000 UTC m=+4.073344643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:18.930006 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:18.929969    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:19.002448 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.002362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:19.002609 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.002572    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:19.002672 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.002612    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:19.002672 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.002626    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:19.002768 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.002693    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:20.002674744 +0000 UTC m=+4.173927831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:19.233400 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.233300    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:18 +0000 UTC" deadline="2028-04-30 04:57:35.883221884 +0000 UTC"
Oct 30 20:38:19.233400 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.233339    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13136h19m16.649887067s"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.383881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.384037    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.384124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.384222    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.384296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:19.384923 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.384372    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:19.413681 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.413559    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wb5s" event={"ID":"514248b1-0652-4a5a-bc20-74442c71b232","Type":"ContainerStarted","Data":"b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054"}
Oct 30 20:38:19.417714 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.417648    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77clk" event={"ID":"539bc22b-62ae-4c20-8d54-8f57f0603995","Type":"ContainerStarted","Data":"69c12c120aa6c5af1e7f0aefe1e771836c96d61a6d4b80be518a47d9f754fc93"}
Oct 30 20:38:19.426919 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.426839    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerStarted","Data":"c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1"}
Oct 30 20:38:19.437076 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.437039    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6rvl" event={"ID":"12625149-ab99-482a-8617-4ef8fe1b541a","Type":"ContainerStarted","Data":"0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790"}
Oct 30 20:38:19.449133 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.448908    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzrsz" event={"ID":"ce4b1301-6a55-465f-af3b-6e1113a45271","Type":"ContainerStarted","Data":"0d53078fae054d09cd5a81dcaeff92d4b03727a0b80bf9520ae0702d5b43b73c"}
Oct 30 20:38:19.450709 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.450591    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qfbjr" event={"ID":"590ec5f5-833c-45d4-aec7-1d3409d62913","Type":"ContainerStarted","Data":"1ede4b8157e7e694a7a392054d68cd1dcb929414507b3c162ee7822c87ab4e22"}
Oct 30 20:38:19.452415 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.452237    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx29f" event={"ID":"b0892a92-0735-4167-b582-537e22ec72c4","Type":"ContainerStarted","Data":"b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949"}
Oct 30 20:38:19.454212 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.454186    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj" event={"ID":"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50","Type":"ContainerStarted","Data":"9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1"}
Oct 30 20:38:19.456104 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.456078    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca"}
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.912555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:19.912631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.912760    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.912818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:21.912798297 +0000 UTC m=+6.084051364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.912889    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:19.912950 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:19.912923    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:21.912911678 +0000 UTC m=+6.084164747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:20.014189 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.013151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:20.014189 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:20.013324    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:20.014189 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:20.013344    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:20.014189 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:20.013356    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:20.015068 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:20.014710    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:22.014677337 +0000 UTC m=+6.185930414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:20.234138 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.234066    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:18 +0000 UTC" deadline="2028-04-03 13:05:57.412358165 +0000 UTC"
Oct 30 20:38:20.234138 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.234134    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12496h27m37.178228433s"
Oct 30 20:38:20.490094 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.489985    2577 generic.go:356] "Generic (PLEG): container finished" podID="3df339c34627d7b2ef5d4c725a2c41ea" containerID="20e454c27428ca3a4f6dcdeb088df6fe710eb6e22f5107a356255dec94922f1f" exitCode=0
Oct 30 20:38:20.490270 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.490086    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerDied","Data":"20e454c27428ca3a4f6dcdeb088df6fe710eb6e22f5107a356255dec94922f1f"}
Oct 30 20:38:20.504885 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.504814    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"dab6cd5a3212618f353a61406cc55b55","Type":"ContainerStarted","Data":"8d0cdbc95b3abc7e6b2362f4ac62f9a8628e3b9f12d44e81d3130f5cba95b548"}
Oct 30 20:38:20.536563 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:20.535348    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal" podStartSLOduration=2.535328419 podStartE2EDuration="2.535328419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:20.534495659 +0000 UTC m=+4.705748746" watchObservedRunningTime="2026-10-30 20:38:20.535328419 +0000 UTC m=+4.706581507"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.384850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.385015    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.385435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.385519    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.385584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:21.385771 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.385666    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:21.519061 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.518979    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerStarted","Data":"382d9dd01173e3ff71974599d1be03cf9b4b997c4a1b0ca14fd75d29e6560f1d"}
Oct 30 20:38:21.930581 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.929830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:21.930581 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:21.929899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:21.930581 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.930075    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:21.930581 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.930141    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:25.93012302 +0000 UTC m=+10.101376108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:21.930581 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.930551    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:21.930940 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:21.930628    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:25.930592831 +0000 UTC m=+10.101845912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:22.031843 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:22.031123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:22.031843 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:22.031329    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:22.031843 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:22.031353    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:22.031843 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:22.031368    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:22.031843 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:22.031430    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:26.031411457 +0000 UTC m=+10.202664521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:22.524750 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:22.524702    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="ef07145b3b1a3e2b847289e1e47b3a62c61e38291e704642ab41ba4d59d84cf6" exitCode=0
Oct 30 20:38:22.525282 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:22.525005    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"ef07145b3b1a3e2b847289e1e47b3a62c61e38291e704642ab41ba4d59d84cf6"}
Oct 30 20:38:22.559716 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:22.558551    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" podStartSLOduration=4.558530206 podStartE2EDuration="4.558530206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:21.541205989 +0000 UTC m=+5.712459077" watchObservedRunningTime="2026-10-30 20:38:22.558530206 +0000 UTC m=+6.729783297"
Oct 30 20:38:23.384447 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:23.384333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:23.384635 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:23.384491    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:23.385016 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:23.384967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:23.385166 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:23.385075    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:23.385166 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:23.385151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:23.385290 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:23.385248    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:23.532803 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:23.532761    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6rvl" event={"ID":"12625149-ab99-482a-8617-4ef8fe1b541a","Type":"ContainerStarted","Data":"b334dc4fae85f18fc5f4a3d01bf147f67394034003984832c123d7cfce34dd79"}
Oct 30 20:38:24.541624 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:24.541524    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wb5s" event={"ID":"514248b1-0652-4a5a-bc20-74442c71b232","Type":"ContainerStarted","Data":"4e4835c618e3ad5c54385c882304ec1f9d5e5b21e0e50535cb168831d6a9e82d"}
Oct 30 20:38:24.565104 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:24.565026    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k6rvl" podStartSLOduration=2.998377444 podStartE2EDuration="7.56500347s" totalImagesPullingTime="4.566626026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:23.554827672 +0000 UTC m=+7.726080802" watchObservedRunningTime="2026-10-30 20:38:24.56500347 +0000 UTC m=+8.736256560"
Oct 30 20:38:25.384296 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.384260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:25.384493 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.384414    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:25.384857 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.384819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:25.384954 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.384920    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:25.385005 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.384972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:25.385062 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.385044    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:25.548467 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.548366    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj" event={"ID":"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50","Type":"ContainerStarted","Data":"09df7a95bcf659c38fadab1d8c2b97dba70890ae74b63aee5ef1c7960fe33717"}
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.972114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:25.972206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.973730    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.973806    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.973814    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:33.973794419 +0000 UTC m=+18.145047500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:25.974554 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:25.973891    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:33.973873748 +0000 UTC m=+18.145126808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:26.073377 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.073314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:26.073545 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:26.073514    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:26.073612 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:26.073555    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:26.073612 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:26.073571    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:26.073709 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:26.073641    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:34.073621109 +0000 UTC m=+18.244874185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:26.272457 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.272427    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:26.394995 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.394884    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:26.2724477Z","UUID":"653a01c2-7a4d-4890-9309-5646219861d5","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:26.398614 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.398562    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:26.398614 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.398608    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:26.552880 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:26.552770    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj" event={"ID":"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50","Type":"ContainerStarted","Data":"9e02aaa871bce8cb235d2704ebdad5769171bf64d4079e3d9050e89e1751217f"}
Oct 30 20:38:27.324487 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.323051    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:27.324487 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.324213    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:27.345262 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.345212    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7wb5s" podStartSLOduration=4.939516404 podStartE2EDuration="10.345195796s" totalImagesPullingTime="5.405679392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:24.56564845 +0000 UTC m=+8.736901537" watchObservedRunningTime="2026-10-30 20:38:27.345195796 +0000 UTC m=+11.516448877"
Oct 30 20:38:27.384428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.384399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:27.384602 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.384409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:27.384602 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:27.384541    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:27.384602 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.384555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:27.384759 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:27.384659    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:27.384844 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:27.384801    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:27.557125 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.557077    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx29f" event={"ID":"b0892a92-0735-4167-b582-537e22ec72c4","Type":"ContainerStarted","Data":"17805e2c7eb5f92aa430c2be8c3633b622de444ba36475f6a9705a22ee794a76"}
Oct 30 20:38:27.559638 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.559613    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj" event={"ID":"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50","Type":"ContainerStarted","Data":"412aca82aca692dbaf8851fdcee7e5377a56a0211a11a594c9d14d370ff57259"}
Oct 30 20:38:27.562792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.562191    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="79f33fa66c1d9867b7062e0202878b7a867f6eff6fedca02b9ec7a43d17708b1" exitCode=0
Oct 30 20:38:27.562792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.562268    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"79f33fa66c1d9867b7062e0202878b7a867f6eff6fedca02b9ec7a43d17708b1"}
Oct 30 20:38:27.564326 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.564270    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qfbjr" event={"ID":"590ec5f5-833c-45d4-aec7-1d3409d62913","Type":"ContainerStarted","Data":"21a948fd639cf9886e238c0fc95fffb2613d0bf907ebff1fb673b7ed55c5e77b"}
Oct 30 20:38:27.577789 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.577710    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-mx29f" podStartSLOduration=2.092814769 podStartE2EDuration="10.577693913s" totalImagesPullingTime="8.484879144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:27.576929582 +0000 UTC m=+11.748182665" watchObservedRunningTime="2026-10-30 20:38:27.577693913 +0000 UTC m=+11.748946998"
Oct 30 20:38:27.627210 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.627156    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-qfbjr" podStartSLOduration=2.365950058 podStartE2EDuration="10.627142061s" totalImagesPullingTime="8.261192003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:27.600445076 +0000 UTC m=+11.771698160" watchObservedRunningTime="2026-10-30 20:38:27.627142061 +0000 UTC m=+11.798395144"
Oct 30 20:38:27.648852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:27.648805    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj" podStartSLOduration=2.16978177 podStartE2EDuration="10.648791317s" totalImagesPullingTime="8.479009547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:27.64877483 +0000 UTC m=+11.820027911" watchObservedRunningTime="2026-10-30 20:38:27.648791317 +0000 UTC m=+11.820044399"
Oct 30 20:38:29.383831 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.383795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:29.384355 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.383870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:29.384355 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.383890    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:29.384355 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:29.383979    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:29.384355 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:29.384081    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:29.384355 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:29.384146    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:29.569779 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.569748    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77clk" event={"ID":"539bc22b-62ae-4c20-8d54-8f57f0603995","Type":"ContainerStarted","Data":"0dee88964d9dfd855de9ab21c1f38664596b6cd4fb40930431e5f702ca16ea67"}
Oct 30 20:38:29.572123 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.572094    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="9132f1243f6af2f0ca8f4d41f3050db936cf8245b2444457d1eabe9e8f525e5e" exitCode=0
Oct 30 20:38:29.572242 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.572175    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"9132f1243f6af2f0ca8f4d41f3050db936cf8245b2444457d1eabe9e8f525e5e"}
Oct 30 20:38:29.573779 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.573755    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzrsz" event={"ID":"ce4b1301-6a55-465f-af3b-6e1113a45271","Type":"ContainerStarted","Data":"5c39473d61f709334ad9ac32225ebf4e178993182dba2fe815ba36a21c7b087c"}
Oct 30 20:38:29.592549 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.590252    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-77clk" podStartSLOduration=4.02865714 podStartE2EDuration="12.590237159s" totalImagesPullingTime="8.561580019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:29.589193917 +0000 UTC m=+13.760447000" watchObservedRunningTime="2026-10-30 20:38:29.590237159 +0000 UTC m=+13.761490243"
Oct 30 20:38:29.611191 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.611139    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mzrsz" podStartSLOduration=1.7425483929999999 podStartE2EDuration="12.611122879s" totalImagesPullingTime="10.868574486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:29.610826084 +0000 UTC m=+13.782079170" watchObservedRunningTime="2026-10-30 20:38:29.611122879 +0000 UTC m=+13.782375966"
Oct 30 20:38:29.952279 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.952244    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:29.952468 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.952428    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:29.952920 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:29.952893    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:31.384255 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:31.384004    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:31.384936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:31.384014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:31.384936 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:31.384360    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:31.384936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:31.384067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:31.384936 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:31.384424    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:31.384936 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:31.384493    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:31.581567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:31.581518    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="7c085e60602e0c12b111e4c6f320f1216062f4ff1ea2a40f89059371fe8cf2da" exitCode=0
Oct 30 20:38:31.581567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:31.581562    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"7c085e60602e0c12b111e4c6f320f1216062f4ff1ea2a40f89059371fe8cf2da"}
Oct 30 20:38:33.383961 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:33.383940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:33.384341 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:33.384108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:33.384341 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:33.384133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:33.384341 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:33.384129    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:33.384341 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:33.384209    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:33.384341 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:33.384285    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:33.587850 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:33.587825    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="4b5a3e7db8c79c258716cc2eb948298f6d3e20004b66ce6bb2610e526da429b3" exitCode=0
Oct 30 20:38:33.587935 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:33.587877    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"4b5a3e7db8c79c258716cc2eb948298f6d3e20004b66ce6bb2610e526da429b3"}
Oct 30 20:38:34.039349 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.039316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:34.039505 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.039362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:34.039505 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.039449    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:34.039505 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.039458    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:34.039639 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.039513    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret podName:50d8f3d8-875f-413d-996a-a4a68910b7fd nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.039497739 +0000 UTC m=+34.210750800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret") pod "global-pull-secret-syncer-8qztc" (UID: "50d8f3d8-875f-413d-996a-a4a68910b7fd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:34.039639 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.039542    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.039521821 +0000 UTC m=+34.210774881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:34.140428 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.140364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:34.140565 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.140464    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:34.140565 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.140477    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:34.140565 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.140485    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zjjvt for pod openshift-network-diagnostics/network-check-target-85qnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:34.140565 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:34.140552    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt podName:9c8823a4-a700-41c4-bb61-bc5144e9d1eb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.14053681 +0000 UTC m=+34.311789884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjjvt" (UniqueName: "kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt") pod "network-check-target-85qnr" (UID: "9c8823a4-a700-41c4-bb61-bc5144e9d1eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:34.592781 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.592699    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="a34ee09047c6bcec6aabacc6c73dbb35975592891192515f3815efcec62fafa6" exitCode=0
Oct 30 20:38:34.593313 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.592776    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerDied","Data":"a34ee09047c6bcec6aabacc6c73dbb35975592891192515f3815efcec62fafa6"}
Oct 30 20:38:34.595823 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.595803    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"ceafcfaeafd4c2c502d911bc90576e4422efe21de574e95e1a6fc5aa7461e3ac"}
Oct 30 20:38:34.595893 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.595878    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"68627f87814cc9235d3c8b58468ec0487976a8f794423fd6b00dfabe0677a7c6"}
Oct 30 20:38:34.595945 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.595932    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"a9a96995e9bfa5dad9d9c94efc4daf440912b8427f3df722cf9c566e04293734"}
Oct 30 20:38:34.595997 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.595984    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"3d13d64369b4815c3914a3835ef4a1e296cea30c4597e4d9ed9927dd9e567477"}
Oct 30 20:38:34.596049 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.596037    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"74af91c02aba8040a5890143148829e276f23a0af702caeb305ec5e22eeee4de"}
Oct 30 20:38:34.596102 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:34.596089    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"d71b2b09406519363c4f5418cce0aac200d5e8e211d543f39ee9834811c5fafa"}
Oct 30 20:38:35.384398 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:35.384354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:35.384579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:35.384428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:35.384579 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:35.384455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:35.384679 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:35.384568    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:35.384679 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:35.384593    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:35.384679 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:35.384657    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:35.601284 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:35.601248    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" event={"ID":"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5","Type":"ContainerStarted","Data":"3643a2e6fd4896865139bea4cc66ff61be3c1555eb7b836ceae706ee738e2b1e"}
Oct 30 20:38:35.632420 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:35.632379    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nzzx9" podStartSLOduration=7.061502193 podStartE2EDuration="18.632367837s" totalImagesPullingTime="11.570865644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:35.629487952 +0000 UTC m=+19.800741034" watchObservedRunningTime="2026-10-30 20:38:35.632367837 +0000 UTC m=+19.803620919"
Oct 30 20:38:36.606233 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:36.606202    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"4124abba7dfe2a2d8c185a5d7e9ad5f2c324742e7f7aa00ea15c183be508ba2e"}
Oct 30 20:38:37.383936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:37.383903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:37.383936 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:37.383928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:37.384134 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:37.383933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:37.384134 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:37.384031    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:37.384134 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:37.384122    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:37.384231 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:37.384208    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:38.613469 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:38.613427    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" event={"ID":"7b62c70f-47d9-4521-8e32-e5c65c0c7e87","Type":"ContainerStarted","Data":"a57f645d743a40f68c5cfebf3aff98ff8c75f03d625dd6ad3b0ecda4ba0eede4"}
Oct 30 20:38:38.613967 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:38.613795    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:38.629299 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:38.629270    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:38.657122 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:38.657077    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w" podStartSLOduration=6.650261916 podStartE2EDuration="21.657065014s" totalImagesPullingTime="15.006803098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:38.656761519 +0000 UTC m=+22.828014600" watchObservedRunningTime="2026-10-30 20:38:38.657065014 +0000 UTC m=+22.828318097"
Oct 30 20:38:39.384336 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.384305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:39.384549 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.384441    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:39.384549 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.384462    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:39.384646 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.384585    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:39.384646 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.384613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:39.384716 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.384674    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:39.615734 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.615700    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:39.616197 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.615769    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:39.630468 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.630438    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:39.784407 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.784318    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qztc"]
Oct 30 20:38:39.784568 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.784437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:39.784568 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.784555    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:39.788593 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.788567    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85qnr"]
Oct 30 20:38:39.788715 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.788691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:39.788821 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.788804    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:39.790850 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.790627    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knt4f"]
Oct 30 20:38:39.790850 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:39.790795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:39.791021 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:39.790950    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:41.384505 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:41.384463    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:41.385084 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:41.384561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:41.385084 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:41.384585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:41.385084 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:41.384730    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:41.385084 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:41.384848    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:41.385084 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:41.384916    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:43.384707 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:43.384679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:43.385236 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:43.384680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:43.385236 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:43.384794    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:43.385236 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:43.384862    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:43.385236 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:43.384689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:43.385236 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:43.384939    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:45.384183 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:45.384148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:45.384183 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:45.384187    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:45.384652 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:45.384151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:45.384652 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:45.384247    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85qnr" podUID="9c8823a4-a700-41c4-bb61-bc5144e9d1eb"
Oct 30 20:38:45.384652 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:45.384370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qztc" podUID="50d8f3d8-875f-413d-996a-a4a68910b7fd"
Oct 30 20:38:45.384652 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:45.384441    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knt4f" podUID="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7"
Oct 30 20:38:46.606047 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.605906    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeReady"
Oct 30 20:38:46.606381 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.606163    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:38:46.658952 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.658924    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ghwzz"]
Oct 30 20:38:46.662796 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.662772    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v92r5"]
Oct 30 20:38:46.662922 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.662881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:46.666163 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.666144    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2hkcr"]
Oct 30 20:38:46.666331 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.666303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:46.669738 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.669719    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"]
Oct 30 20:38:46.669876 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.669858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:46.672137 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.672118    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.672874 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.672858    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6987c8f769-xrp2s"]
Oct 30 20:38:46.672962 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.672949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.682550 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.682516    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"]
Oct 30 20:38:46.682825 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.682639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.686509 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.686487    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p8qgf"]
Oct 30 20:38:46.686714 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.686698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.688610 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.688591    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:38:46.689569 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.689511    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xhgsl\""
Oct 30 20:38:46.692441 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.689887    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"]
Oct 30 20:38:46.692441 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.689966    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.693423 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.693406    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-2psb7"]
Oct 30 20:38:46.693548 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.693520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.695746 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.695726    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:38:46.695870 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.695841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.699142 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.699125    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"]
Oct 30 20:38:46.699236 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.699215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.703466 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.703450    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"]
Oct 30 20:38:46.703569 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.703559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.705846 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.705831    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"]
Oct 30 20:38:46.705969 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.705953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:46.709285 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.709269    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"]
Oct 30 20:38:46.709391 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.709377    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.712593 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.712575    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"]
Oct 30 20:38:46.712708 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.712692    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:46.716910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.716063    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ghwzz"]
Oct 30 20:38:46.716910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.716098    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v92r5"]
Oct 30 20:38:46.716910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.716118    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2hkcr"]
Oct 30 20:38:46.716910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.716141    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"]
Oct 30 20:38:46.716910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.716161    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8llmk"]
Oct 30 20:38:46.717507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.717471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.719462 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.719445    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"]
Oct 30 20:38:46.719556 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.719481    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zmw72"]
Oct 30 20:38:46.719628 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.719560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723701    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-2psb7"]
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723734    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6987c8f769-xrp2s"]
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723751    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"]
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723772    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"]
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723795    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"]
Oct 30 20:38:46.726573 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.723866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.730990 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.730967    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:38:46.734696 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.734678    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"]
Oct 30 20:38:46.735414 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.735397    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p8qgf"]
Oct 30 20:38:46.736075 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.736055    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"]
Oct 30 20:38:46.736742 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.736724    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"]
Oct 30 20:38:46.745037 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.744995    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8llmk"]
Oct 30 20:38:46.750835 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.750813    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmw72"]
Oct 30 20:38:46.771098 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771080    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:38:46.771444 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771426    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771588 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771447    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771588 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771505    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771588 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771516    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771610    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771616    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771611    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771645    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771662    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771678    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771681    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771694    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771705    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771722    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771726    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771733    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771737    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771762    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771764    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771765    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771773    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771794    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.771792 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.771803    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.773046 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.773032    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:38:46.773117 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.773073    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.773850 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.773829    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:38:46.773937 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.773869    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:46.774202 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.774188    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:38:46.783385 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.783371    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:38:46.794712 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794684    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:38:46.794799 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794712    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:38:46.794799 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794741    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:38:46.794890 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794807    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:38:46.794890 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794841    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:38:46.794987 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.794874    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:38:46.795878 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.795864    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:38:46.795953 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.795930    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:38:46.796128 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.796113    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:38:46.796195 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.796173    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:38:46.796195 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.796179    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:38:46.797436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797418    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d6mm6\""
Oct 30 20:38:46.797436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797430    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vr4kn\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797437    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vhjmh\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797461    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797483    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-5cndb\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797499    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pl5jd\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797436    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797512    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797514    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ndr57\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797514    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xcggs\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797519    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9vx2g\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797425    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-f59gk\""
Oct 30 20:38:46.797615 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797615    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:38:46.798199 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797657    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bv2n9\""
Oct 30 20:38:46.798199 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797809    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kjrht\""
Oct 30 20:38:46.798199 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.797873    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cr4sq\""
Oct 30 20:38:46.798334 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.798309    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:38:46.798722 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.798685    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:38:46.829608 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.829692 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5wkh\" (UniqueName: \"kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.829692 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.829692 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.829791 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.829791 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.829791 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.829872 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.829872 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.829933 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.829933 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7cz\" (UniqueName: \"kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz\") pod \"volume-data-source-validator-58c9f5f46d-hq7l2\" (UID: \"44d448e2-3ecb-4f8e-a8a9-9220518c481c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:46.829994 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.829994 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5846\" (UniqueName: \"kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.830051 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.829999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.830051 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.830051 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.830136 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwbw4\" (UniqueName: \"kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.830136 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgpn\" (UniqueName: \"kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn\") pod \"network-check-source-6f78d59f99-nffwz\" (UID: \"d40186c5-2e27-4466-9673-61b5de376741\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:46.830136 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.830255 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.830255 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.830255 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.830255 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.830363 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.830363 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57q8t\" (UniqueName: \"kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.830363 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhsf6\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.830363 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.830473 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.830473 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.830473 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.830575 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.830575 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.830635 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.830635 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830592    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.830635 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.830635 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.830741 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8brj\" (UniqueName: \"kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.830741 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.830741 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.830822 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4srqc\" (UniqueName: \"kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.830822 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2k8l\" (UniqueName: \"kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l\") pod \"kas-connection-checker-685895c7c9-v92r5\" (UID: \"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99\") " pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:46.830822 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.830822 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrq9\" (UniqueName: \"kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.830822 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.830955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.830955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8t6t\" (UniqueName: \"kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t\") pod \"kas-connection-checker-685895c7c9-ghwzz\" (UID: \"22d96d38-8111-4e17-9bcf-14205835c57c\") " pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:46.830955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.830955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.831064 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.831064 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.830985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvvz\" (UniqueName: \"kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.831064 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.831064 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjk8j\" (UniqueName: \"kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j\") pod \"kas-connection-checker-685895c7c9-2hkcr\" (UID: \"78825b89-4bdd-4e7c-b145-e3f5b3eab767\") " pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:46.831173 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.831173 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.831173 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsq29\" (UniqueName: \"kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.831173 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.831132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.931811 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.931811 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5846\" (UniqueName: \"kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.931811 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.931811 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwbw4\" (UniqueName: \"kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgpn\" (UniqueName: \"kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn\") pod \"network-check-source-6f78d59f99-nffwz\" (UID: \"d40186c5-2e27-4466-9673-61b5de376741\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.931946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.932005    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.932036    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.932068    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.432049781 +0000 UTC m=+31.603302861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.932092    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert podName:4ef66a03-585f-43d9-b678-7c5e84ad17f8 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.432081506 +0000 UTC m=+31.603334566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-2psb7" (UID: "4ef66a03-585f-43d9-b678-7c5e84ad17f8") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57q8t\" (UniqueName: \"kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.932419 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932325    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhsf6\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.932609    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.43259636 +0000 UTC m=+31.603849448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8brj\" (UniqueName: \"kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.933187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4srqc\" (UniqueName: \"kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2k8l\" (UniqueName: \"kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l\") pod \"kas-connection-checker-685895c7c9-v92r5\" (UID: \"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99\") " pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933429    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrq9\" (UniqueName: \"kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8t6t\" (UniqueName: \"kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t\") pod \"kas-connection-checker-685895c7c9-ghwzz\" (UID: \"22d96d38-8111-4e17-9bcf-14205835c57c\") " pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvvz\" (UniqueName: \"kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjk8j\" (UniqueName: \"kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j\") pod \"kas-connection-checker-685895c7c9-2hkcr\" (UID: \"78825b89-4bdd-4e7c-b145-e3f5b3eab767\") " pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:46.933981 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsq29\" (UniqueName: \"kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5wkh\" (UniqueName: \"kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.933673    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.934757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7cz\" (UniqueName: \"kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz\") pod \"volume-data-source-validator-58c9f5f46d-hq7l2\" (UID: \"44d448e2-3ecb-4f8e-a8a9-9220518c481c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:46.935472 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934750    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.935472 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.934980    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.935472 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.935408    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:46.935748 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.935729    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.932808    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.936210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.933015    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.936244    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c697d468-vwwrx: secret "image-registry-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.936296    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls podName:431fae52-1d80-468d-bdc3-cab61bc318ad nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.436281162 +0000 UTC m=+31.607534242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls") pod "image-registry-c697d468-vwwrx" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad") : secret "image-registry-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.935629    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.936343    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls podName:4ea22bf5-fa1a-46e5-9a03-002f5086b4fa nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.436331632 +0000 UTC m=+31.607584715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-gcjn9" (UID: "4ea22bf5-fa1a-46e5-9a03-002f5086b4fa") : secret "samples-operator-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.935768    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.936380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls podName:ed48d0ae-a851-40ae-89cc-03cd70d91da4 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.436373055 +0000 UTC m=+31.607626154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls") pod "dns-default-8llmk" (UID: "ed48d0ae-a851-40ae-89cc-03cd70d91da4") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.936625    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.937425    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.937435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.937710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.937973    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.937983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.938852 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938078    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938317    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938424    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938561    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.938768    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.938788    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.938813    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls podName:a99477a2-e4e4-4608-a66e-00009ec9f50d nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.438798905 +0000 UTC m=+31.610051982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wx776" (UID: "a99477a2-e4e4-4608-a66e-00009ec9f50d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.939167    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.939507 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.939381    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.939846 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.939798    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.940069 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.940051    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.940164 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.940152    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:46.940223 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.940168    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cdf9fc8f-nf6xb: secret "image-registry-tls" not found
Oct 30 20:38:46.940223 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:46.940216    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls podName:5372497c-4ed1-445c-966c-8693956a6b1e nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.440202748 +0000 UTC m=+31.611455825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls") pod "image-registry-54cdf9fc8f-nf6xb" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e") : secret "image-registry-tls" not found
Oct 30 20:38:46.940360 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.940342    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.940397 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.940353    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.940913 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.940893    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.954887 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.954863    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwbw4\" (UniqueName: \"kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:46.955605 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.955568    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5846\" (UniqueName: \"kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:46.956219 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.956198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhsf6\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.956219 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.956201    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.956325 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.956281    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57q8t\" (UniqueName: \"kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:46.956378 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.956349    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgpn\" (UniqueName: \"kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn\") pod \"network-check-source-6f78d59f99-nffwz\" (UID: \"d40186c5-2e27-4466-9673-61b5de376741\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:46.957809 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.957790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:46.958410 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.958356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7cz\" (UniqueName: \"kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz\") pod \"volume-data-source-validator-58c9f5f46d-hq7l2\" (UID: \"44d448e2-3ecb-4f8e-a8a9-9220518c481c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:46.959290 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.959265    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8t6t\" (UniqueName: \"kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t\") pod \"kas-connection-checker-685895c7c9-ghwzz\" (UID: \"22d96d38-8111-4e17-9bcf-14205835c57c\") " pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:46.959474 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.959422    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvvz\" (UniqueName: \"kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:46.964436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.964407    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4srqc\" (UniqueName: \"kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:46.964593 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.964553    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2k8l\" (UniqueName: \"kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l\") pod \"kas-connection-checker-685895c7c9-v92r5\" (UID: \"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99\") " pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:46.964786 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.964763    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrq9\" (UniqueName: \"kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:46.964850 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.964836    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8brj\" (UniqueName: \"kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:46.964993 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.964966    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5wkh\" (UniqueName: \"kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:46.965192 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.965175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjk8j\" (UniqueName: \"kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j\") pod \"kas-connection-checker-685895c7c9-2hkcr\" (UID: \"78825b89-4bdd-4e7c-b145-e3f5b3eab767\") " pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:46.965842 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.965823    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:46.966713 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.966692    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsq29\" (UniqueName: \"kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:46.980186 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.980167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:46.990884 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.990865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:46.996464 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:46.996447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:47.003582 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.003556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:47.028691 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.028658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:47.039003 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.034877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:47.067374 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.066847    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:47.077211 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.077039    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:47.093154 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.079352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:47.096894 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.096708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:47.291259 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.291240    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2hkcr"]
Oct 30 20:38:47.294116 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.294044    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78825b89_4bdd_4e7c_b145_e3f5b3eab767.slice/crio-8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616 WatchSource:0}: Error finding container 8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616: Status 404 returned error can't find the container with id 8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616
Oct 30 20:38:47.295836 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.295632    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ghwzz"]
Oct 30 20:38:47.296384 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.296362    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a4dcfe_ec1d_46d3_a3fd_dc1607b86e99.slice/crio-33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386 WatchSource:0}: Error finding container 33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386: Status 404 returned error can't find the container with id 33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386
Oct 30 20:38:47.296856 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.296833    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-v92r5"]
Oct 30 20:38:47.297233 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.297205    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d96d38_8111_4e17_9bcf_14205835c57c.slice/crio-8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8 WatchSource:0}: Error finding container 8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8: Status 404 returned error can't find the container with id 8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8
Oct 30 20:38:47.308902 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.308807    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"]
Oct 30 20:38:47.375795 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.375717    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"]
Oct 30 20:38:47.378959 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.378003    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p8qgf"]
Oct 30 20:38:47.380442 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.380417    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"]
Oct 30 20:38:47.380904 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.380882    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d448e2_3ecb_4f8e_a8a9_9220518c481c.slice/crio-1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284 WatchSource:0}: Error finding container 1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284: Status 404 returned error can't find the container with id 1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284
Oct 30 20:38:47.383495 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.383442    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876aecfc_cf95_4ebc_8161_c89868e64e8d.slice/crio-5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446 WatchSource:0}: Error finding container 5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446: Status 404 returned error can't find the container with id 5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446
Oct 30 20:38:47.384171 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.384103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:47.384267 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.384246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:47.384336 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.384321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:47.385508 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.385482    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a35cdb_dc87_4e5e_8183_e42a6db8995f.slice/crio-2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115 WatchSource:0}: Error finding container 2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115: Status 404 returned error can't find the container with id 2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115
Oct 30 20:38:47.390247 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.390223    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:47.390337 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.390275    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ndwvd\""
Oct 30 20:38:47.390448 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.390325    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p7gr\""
Oct 30 20:38:47.390448 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.390366    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:47.390658 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.390467    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-d5kr7\""
Oct 30 20:38:47.391596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.391577    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"]
Oct 30 20:38:47.440965 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.440906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:47.440965 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.440956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.440995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.441038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441051    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441054    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.441067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:47.441116 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441113    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls podName:a99477a2-e4e4-4608-a66e-00009ec9f50d nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441096546 +0000 UTC m=+32.612349612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wx776" (UID: "a99477a2-e4e4-4608-a66e-00009ec9f50d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441115    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441156    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441178    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441150831 +0000 UTC m=+32.612403917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441208    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert podName:4ef66a03-585f-43d9-b678-7c5e84ad17f8 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441197027 +0000 UTC m=+32.612450101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-2psb7" (UID: "4ef66a03-585f-43d9-b678-7c5e84ad17f8") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441235    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441226024 +0000 UTC m=+32.612479098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441275    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls podName:ed48d0ae-a851-40ae-89cc-03cd70d91da4 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441265544 +0000 UTC m=+32.612518613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls") pod "dns-default-8llmk" (UID: "ed48d0ae-a851-40ae-89cc-03cd70d91da4") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.441297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.441343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441362    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441371    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c697d468-vwwrx: secret "image-registry-tls" not found
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.441388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:47.441396 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441397    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls podName:431fae52-1d80-468d-bdc3-cab61bc318ad nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441388119 +0000 UTC m=+32.612641197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls") pod "image-registry-c697d468-vwwrx" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad") : secret "image-registry-tls" not found
Oct 30 20:38:47.441837 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441428    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:47.441837 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441460    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:47.441837 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441464    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls podName:4ea22bf5-fa1a-46e5-9a03-002f5086b4fa nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.441451634 +0000 UTC m=+32.612704694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-gcjn9" (UID: "4ea22bf5-fa1a-46e5-9a03-002f5086b4fa") : secret "samples-operator-tls" not found
Oct 30 20:38:47.441837 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441472    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cdf9fc8f-nf6xb: secret "image-registry-tls" not found
Oct 30 20:38:47.441837 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:47.441518    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls podName:5372497c-4ed1-445c-966c-8693956a6b1e nodeName:}" failed. No retries permitted until 2026-10-30 20:38:48.4415065 +0000 UTC m=+32.612759584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls") pod "image-registry-54cdf9fc8f-nf6xb" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e") : secret "image-registry-tls" not found
Oct 30 20:38:47.459786 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.459763    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"]
Oct 30 20:38:47.462378 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.462357    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40186c5_2e27_4466_9673_61b5de376741.slice/crio-714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57 WatchSource:0}: Error finding container 714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57: Status 404 returned error can't find the container with id 714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57
Oct 30 20:38:47.462716 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.462699    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zmw72"]
Oct 30 20:38:47.465769 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:47.465749    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e031a4_99dd_4bbc_b69f_1e5c85e3ac77.slice/crio-683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e WatchSource:0}: Error finding container 683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e: Status 404 returned error can't find the container with id 683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e
Oct 30 20:38:47.634740 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.634705    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmw72" event={"ID":"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77","Type":"ContainerStarted","Data":"683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e"}
Oct 30 20:38:47.636058 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.636030    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7" event={"ID":"c8a35cdb-dc87-4e5e-8183-e42a6db8995f","Type":"ContainerStarted","Data":"2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115"}
Oct 30 20:38:47.637239 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.637218    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerStarted","Data":"a1d1a5bbea5ad4e57b9e02bf10d654b2c48284c5a5fe6106b501f2bb20789c03"}
Oct 30 20:38:47.638626 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.638606    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2hkcr" event={"ID":"78825b89-4bdd-4e7c-b145-e3f5b3eab767","Type":"ContainerStarted","Data":"88a5c0458f94902255d3830a976c82d23f8608028b61d07062cdbb06eac8e5a5"}
Oct 30 20:38:47.638714 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.638646    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2hkcr" event={"ID":"78825b89-4bdd-4e7c-b145-e3f5b3eab767","Type":"ContainerStarted","Data":"8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616"}
Oct 30 20:38:47.639706 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.639685    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc" event={"ID":"3e3625a5-852d-480b-a6e8-91ab6b2778b3","Type":"ContainerStarted","Data":"5266bcb6302630209cfd53396565f8f75e6aa9e3876093466dc0076a890b60e0"}
Oct 30 20:38:47.640974 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.640954    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-v92r5" event={"ID":"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99","Type":"ContainerStarted","Data":"0ac2fad1a4aad4698962b10cb04118b9b69bf29596cde227651b5dd08f70a640"}
Oct 30 20:38:47.641057 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.640986    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-v92r5" event={"ID":"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99","Type":"ContainerStarted","Data":"33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386"}
Oct 30 20:38:47.642043 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.642025    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz" event={"ID":"d40186c5-2e27-4466-9673-61b5de376741","Type":"ContainerStarted","Data":"714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57"}
Oct 30 20:38:47.643123 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.643100    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p8qgf" event={"ID":"876aecfc-cf95-4ebc-8161-c89868e64e8d","Type":"ContainerStarted","Data":"5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446"}
Oct 30 20:38:47.644384 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.644360    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ghwzz" event={"ID":"22d96d38-8111-4e17-9bcf-14205835c57c","Type":"ContainerStarted","Data":"7df2f27906a4a2e3c4e720908ca4ff361ccdab164cc078f92c610e995e52f610"}
Oct 30 20:38:47.644464 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.644401    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ghwzz" event={"ID":"22d96d38-8111-4e17-9bcf-14205835c57c","Type":"ContainerStarted","Data":"8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8"}
Oct 30 20:38:47.645416 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.645396    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2" event={"ID":"44d448e2-3ecb-4f8e-a8a9-9220518c481c","Type":"ContainerStarted","Data":"1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284"}
Oct 30 20:38:47.657575 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.657518    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-2hkcr" podStartSLOduration=452.657506724 podStartE2EDuration="7m32.657506724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:47.65681027 +0000 UTC m=+31.828063364" watchObservedRunningTime="2026-10-30 20:38:47.657506724 +0000 UTC m=+31.828759803"
Oct 30 20:38:47.679952 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.679913    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-v92r5" podStartSLOduration=452.679904967 podStartE2EDuration="7m32.679904967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:47.679819865 +0000 UTC m=+31.851072948" watchObservedRunningTime="2026-10-30 20:38:47.679904967 +0000 UTC m=+31.851158043"
Oct 30 20:38:47.701769 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:47.701706    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-ghwzz" podStartSLOduration=452.701693222 podStartE2EDuration="7m32.701693222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:47.700700835 +0000 UTC m=+31.871953916" watchObservedRunningTime="2026-10-30 20:38:47.701693222 +0000 UTC m=+31.872946303"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.452606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.452681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.452745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.452783    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.452860    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls podName:a99477a2-e4e4-4608-a66e-00009ec9f50d nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.45283873 +0000 UTC m=+34.624091850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wx776" (UID: "a99477a2-e4e4-4608-a66e-00009ec9f50d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.452890    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.452874543 +0000 UTC m=+34.624127626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.452974    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453011    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.452999361 +0000 UTC m=+34.624252440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453062    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453103    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert podName:4ef66a03-585f-43d9-b678-7c5e84ad17f8 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.453082124 +0000 UTC m=+34.624335230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-2psb7" (UID: "4ef66a03-585f-43d9-b678-7c5e84ad17f8") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.452789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.453149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.453213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.453250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:48.453546 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453284    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453328    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls podName:ed48d0ae-a851-40ae-89cc-03cd70d91da4 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.453315368 +0000 UTC m=+34.624568446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls") pod "dns-default-8llmk" (UID: "ed48d0ae-a851-40ae-89cc-03cd70d91da4") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453336    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:48.453288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453347    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cdf9fc8f-nf6xb: secret "image-registry-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls podName:5372497c-4ed1-445c-966c-8693956a6b1e nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.453368742 +0000 UTC m=+34.624621821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls") pod "image-registry-54cdf9fc8f-nf6xb" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e") : secret "image-registry-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453429    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453435    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453446    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c697d468-vwwrx: secret "image-registry-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453453    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls podName:4ea22bf5-fa1a-46e5-9a03-002f5086b4fa nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.453443994 +0000 UTC m=+34.624697090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-gcjn9" (UID: "4ea22bf5-fa1a-46e5-9a03-002f5086b4fa") : secret "samples-operator-tls" not found
Oct 30 20:38:48.454368 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:48.453482    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls podName:431fae52-1d80-468d-bdc3-cab61bc318ad nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.453470609 +0000 UTC m=+34.624723689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls") pod "image-registry-c697d468-vwwrx" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad") : secret "image-registry-tls" not found
Oct 30 20:38:50.079420 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.079349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:50.079774 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.079426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:50.079774 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.079636    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:50.079774 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.079706    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs podName:5ef0d2d8-9e6e-485e-8db3-59668d3fefb7 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:22.079686466 +0000 UTC m=+66.250939530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs") pod "network-metrics-daemon-knt4f" (UID: "5ef0d2d8-9e6e-485e-8db3-59668d3fefb7") : secret "metrics-daemon-secret" not found
Oct 30 20:38:50.083905 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.083876    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:50.180797 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.180759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:50.184864 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.184807    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:50.214667 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.214441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:50.435430 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.435199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.484741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.484887    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.484951    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls podName:ed48d0ae-a851-40ae-89cc-03cd70d91da4 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.484932024 +0000 UTC m=+38.656185103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls") pod "dns-default-8llmk" (UID: "ed48d0ae-a851-40ae-89cc-03cd70d91da4") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485357    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485374    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c697d468-vwwrx: secret "image-registry-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485421    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls podName:431fae52-1d80-468d-bdc3-cab61bc318ad nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485406302 +0000 UTC m=+38.656659379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls") pod "image-registry-c697d468-vwwrx" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad") : secret "image-registry-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485484    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485534    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls podName:4ea22bf5-fa1a-46e5-9a03-002f5086b4fa nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485509663 +0000 UTC m=+38.656762739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-gcjn9" (UID: "4ea22bf5-fa1a-46e5-9a03-002f5086b4fa") : secret "samples-operator-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485591    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:50.485980 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485601    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cdf9fc8f-nf6xb: secret "image-registry-tls" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485630    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls podName:5372497c-4ed1-445c-966c-8693956a6b1e nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485619686 +0000 UTC m=+38.656872760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls") pod "image-registry-54cdf9fc8f-nf6xb" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e") : secret "image-registry-tls" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485684    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485717    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls podName:a99477a2-e4e4-4608-a66e-00009ec9f50d nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485706408 +0000 UTC m=+38.656959482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wx776" (UID: "a99477a2-e4e4-4608-a66e-00009ec9f50d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485770    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485799    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485789351 +0000 UTC m=+38.657042428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485851    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485884    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert podName:4ef66a03-585f-43d9-b678-7c5e84ad17f8 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485872418 +0000 UTC m=+38.657125492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-2psb7" (UID: "4ef66a03-585f-43d9-b678-7c5e84ad17f8") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:50.487035 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:50.485950    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.485940221 +0000 UTC m=+38.657193298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:50.567601 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.567575    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qztc"]
Oct 30 20:38:50.570393 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:50.570364    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d8f3d8_875f_413d_996a_a4a68910b7fd.slice/crio-74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65 WatchSource:0}: Error finding container 74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65: Status 404 returned error can't find the container with id 74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65
Oct 30 20:38:50.663452 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.662645    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2" event={"ID":"44d448e2-3ecb-4f8e-a8a9-9220518c481c","Type":"ContainerStarted","Data":"04e2f6cb5ee6b0661f7cfeb4e3919d3a7c15fdb5594687951ee950dc6f218d31"}
Oct 30 20:38:50.665730 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.665659    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qztc" event={"ID":"50d8f3d8-875f-413d-996a-a4a68910b7fd","Type":"ContainerStarted","Data":"74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65"}
Oct 30 20:38:50.750567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.749144    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2" podStartSLOduration=393.408214537 podStartE2EDuration="6m35.749122106s" totalImagesPullingTime="2.340907569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:50.684475626 +0000 UTC m=+34.855728709" watchObservedRunningTime="2026-10-30 20:38:50.749122106 +0000 UTC m=+34.920375193"
Oct 30 20:38:50.750567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:50.749626    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85qnr"]
Oct 30 20:38:50.763097 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:50.763052    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8823a4_a700_41c4_bb61_bc5144e9d1eb.slice/crio-991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8 WatchSource:0}: Error finding container 991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8: Status 404 returned error can't find the container with id 991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8
Oct 30 20:38:51.671914 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:51.671839    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85qnr" event={"ID":"9c8823a4-a700-41c4-bb61-bc5144e9d1eb","Type":"ContainerStarted","Data":"991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8"}
Oct 30 20:38:51.674745 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:51.674722    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/0.log"
Oct 30 20:38:51.674858 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:51.674756    2577 generic.go:356] "Generic (PLEG): container finished" podID="69b633d2-97d9-4a07-9506-45658f48ee49" containerID="dae273f10cec2ed3e33c035d87a98e0c2a36bde5f7338925c5ed52b6f4dc5243" exitCode=255
Oct 30 20:38:51.675512 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:51.675494    2577 scope.go:122] "RemoveContainer" containerID="dae273f10cec2ed3e33c035d87a98e0c2a36bde5f7338925c5ed52b6f4dc5243"
Oct 30 20:38:51.675795 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:51.675774    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerDied","Data":"dae273f10cec2ed3e33c035d87a98e0c2a36bde5f7338925c5ed52b6f4dc5243"}
Oct 30 20:38:52.682834 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.681604    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p8qgf" event={"ID":"876aecfc-cf95-4ebc-8161-c89868e64e8d","Type":"ContainerStarted","Data":"c824df0080cea28f41b1d9e4034e4e9d0c4a16592f6b9a4db8b99c2f7d6b25f2"}
Oct 30 20:38:52.686262 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.685763    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7" event={"ID":"c8a35cdb-dc87-4e5e-8183-e42a6db8995f","Type":"ContainerStarted","Data":"f6c2a0589d23cd5990be5fd0bba6cb66e81c7708d822dc014b5341ede495bd10"}
Oct 30 20:38:52.691019 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.690934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.691686    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/0.log"
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.691721    2577 generic.go:356] "Generic (PLEG): container finished" podID="69b633d2-97d9-4a07-9506-45658f48ee49" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391" exitCode=255
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.691799    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerDied","Data":"cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"}
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.691840    2577 scope.go:122] "RemoveContainer" containerID="dae273f10cec2ed3e33c035d87a98e0c2a36bde5f7338925c5ed52b6f4dc5243"
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.692167    2577 scope.go:122] "RemoveContainer" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"
Oct 30 20:38:52.692567 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:52.692395    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:38:52.695919 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.695896    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc" event={"ID":"3e3625a5-852d-480b-a6e8-91ab6b2778b3","Type":"ContainerStarted","Data":"61a96090a22fe0d66c01dc43442eac6c22036a4f8e0e1366cdea16f34ba801b0"}
Oct 30 20:38:52.735144 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.734351    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-p8qgf" podStartSLOduration=399.823100262 podStartE2EDuration="6m44.734332943s" totalImagesPullingTime="4.911232681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:52.706487676 +0000 UTC m=+36.877740760" watchObservedRunningTime="2026-10-30 20:38:52.734332943 +0000 UTC m=+36.905586027"
Oct 30 20:38:52.758625 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.757646    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7" podStartSLOduration=396.850091466 podStartE2EDuration="6m41.757628622s" totalImagesPullingTime="4.907537156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:52.756814218 +0000 UTC m=+36.928067301" watchObservedRunningTime="2026-10-30 20:38:52.757628622 +0000 UTC m=+36.928881702"
Oct 30 20:38:52.778037 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:52.777988    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc" podStartSLOduration=392.869058116 podStartE2EDuration="6m37.777974809s" totalImagesPullingTime="4.908916693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:52.776745802 +0000 UTC m=+36.947998908" watchObservedRunningTime="2026-10-30 20:38:52.777974809 +0000 UTC m=+36.949227923"
Oct 30 20:38:53.083722 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.083635    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9xhnp"]
Oct 30 20:38:53.113726 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.113693    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:38:53.114892 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.114869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.127807 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.127763    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:38:53.127807 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.127802    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:38:53.127952 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.127897    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2twjb\""
Oct 30 20:38:53.133487 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.133463    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xhnp"]
Oct 30 20:38:53.133600 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.133517    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:38:53.133644 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.133615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fp5n\" (UniqueName: \"kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.225832 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.217462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318198 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318198 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.318356 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.318356 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318356 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fp5n\" (UniqueName: \"kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318356 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.318463 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318463 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.318540 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318662 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318646    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.318997 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.318975    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.319471 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.319450    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.320656 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.319539    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.819503106 +0000 UTC m=+37.990756166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.320656 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.319801    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:53.320656 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.320000    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.819981208 +0000 UTC m=+37.991234269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:53.326162 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.326138    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.326357 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.326342    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.327018 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.326996    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.345179 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.345098    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fp5n\" (UniqueName: \"kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.357353 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.357327    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.390083 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.390049    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gw6lr"]
Oct 30 20:38:53.413924 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.413891    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gw6lr"]
Oct 30 20:38:53.414048 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.414012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.420087 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.420059    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.420087 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.420076    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 20:38:53.420253 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.420130    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 20:38:53.420630 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.420613    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zrd5p\""
Oct 30 20:38:53.420733 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.420683    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.505638 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.502605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:53.521077 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.520996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rljt\" (UniqueName: \"kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.521231 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.521209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.521305 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.521251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.535828 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.534765    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"]
Oct 30 20:38:53.568262 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.568235    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"]
Oct 30 20:38:53.568425 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.568378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:53.574810 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.574786    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.574915 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.574898    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rx7vx\""
Oct 30 20:38:53.575009 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.574996    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.586109 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.586088    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"]
Oct 30 20:38:53.586211 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.586129    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"]
Oct 30 20:38:53.586211 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.586198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:53.621828 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.621794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2smsw\" (UniqueName: \"kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw\") pod \"migrator-66df5d496b-z4gcv\" (UID: \"09ff4a44-54fe-4984-a650-5d182ee89e4c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:53.621935 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.621850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rljt\" (UniqueName: \"kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.621935 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.621880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s2rd\" (UniqueName: \"kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd\") pod \"migrator-66df5d496b-fb5nk\" (UID: \"09460045-d0af-4ea6-8c50-e3516d295859\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:53.622048 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.622033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.622098 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.622072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.624086 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.623425    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.631650 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.631627    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.636223 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.636198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rljt\" (UniqueName: \"kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.700915 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.700874    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zmw72" event={"ID":"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77","Type":"ContainerStarted","Data":"1aa46048c5a64ebb351a1d6412aa542ba5d7c3f5ce7c2263d6a8982b14b1e3d9"}
Oct 30 20:38:53.703801 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.703775    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:38:53.704813 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.704267    2577 scope.go:122] "RemoveContainer" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"
Oct 30 20:38:53.704813 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.704445    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:38:53.723987 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.723954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2smsw\" (UniqueName: \"kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw\") pod \"migrator-66df5d496b-z4gcv\" (UID: \"09ff4a44-54fe-4984-a650-5d182ee89e4c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:53.724103 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.723997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s2rd\" (UniqueName: \"kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd\") pod \"migrator-66df5d496b-fb5nk\" (UID: \"09460045-d0af-4ea6-8c50-e3516d295859\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:53.736911 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.736885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:53.738547 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.738198    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zmw72" podStartSLOduration=2.082937086 podStartE2EDuration="7.73818322s" totalImagesPullingTime="5.655246134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:53.737896992 +0000 UTC m=+37.909150074" watchObservedRunningTime="2026-10-30 20:38:53.73818322 +0000 UTC m=+37.909436301"
Oct 30 20:38:53.760993 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.760947    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2smsw\" (UniqueName: \"kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw\") pod \"migrator-66df5d496b-z4gcv\" (UID: \"09ff4a44-54fe-4984-a650-5d182ee89e4c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:53.761096 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.761054    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s2rd\" (UniqueName: \"kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd\") pod \"migrator-66df5d496b-fb5nk\" (UID: \"09460045-d0af-4ea6-8c50-e3516d295859\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.824933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.825029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.825146    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.825192    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.825181006 +0000 UTC m=+38.996434078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.825567    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.828556 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:53.825618    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.825604092 +0000 UTC m=+38.996857170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.837927 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.837883    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:38:53.845001 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:53.844965    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ea3055_97ae_427c_a023_3169446b3bae.slice/crio-51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af WatchSource:0}: Error finding container 51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af: Status 404 returned error can't find the container with id 51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af
Oct 30 20:38:53.897719 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.897691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:53.918268 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:53.918246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:54.048277 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.048244    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-gw6lr"]
Oct 30 20:38:54.059011 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:54.058976    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372fd9ae_8977_4e6b_999b_f95ef59b0a44.slice/crio-fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a WatchSource:0}: Error finding container fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a: Status 404 returned error can't find the container with id fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a
Oct 30 20:38:54.199416 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.199322    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"]
Oct 30 20:38:54.218002 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:54.217959    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09460045_d0af_4ea6_8c50_e3516d295859.slice/crio-d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f WatchSource:0}: Error finding container d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f: Status 404 returned error can't find the container with id d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f
Oct 30 20:38:54.239141 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.239110    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"]
Oct 30 20:38:54.532777 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:54.532955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:54.532955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:54.532955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:54.532955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:54.532955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:54.533197 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.532976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:54.533197 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.533008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") pod \"image-registry-54cdf9fc8f-nf6xb\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") " pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:54.533197 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533155    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:54.533197 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533171    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cdf9fc8f-nf6xb: secret "image-registry-tls" not found
Oct 30 20:38:54.533367 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533232    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls podName:5372497c-4ed1-445c-966c-8693956a6b1e nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.533212124 +0000 UTC m=+46.704465207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls") pod "image-registry-54cdf9fc8f-nf6xb" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e") : secret "image-registry-tls" not found
Oct 30 20:38:54.533680 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533657    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:54.533782 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls podName:a99477a2-e4e4-4608-a66e-00009ec9f50d nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.533700371 +0000 UTC m=+46.704953447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-wx776" (UID: "a99477a2-e4e4-4608-a66e-00009ec9f50d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:54.533782 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533770    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:54.533907 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533803    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.533793136 +0000 UTC m=+46.705046209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:54.533907 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533865    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:54.533907 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert podName:4ef66a03-585f-43d9-b678-7c5e84ad17f8 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.533885862 +0000 UTC m=+46.705138939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-2psb7" (UID: "4ef66a03-585f-43d9-b678-7c5e84ad17f8") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:54.534062 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.533965    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.533954801 +0000 UTC m=+46.705207876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:54.534062 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534023    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:54.534062 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534052    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls podName:ed48d0ae-a851-40ae-89cc-03cd70d91da4 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.534042793 +0000 UTC m=+46.705295867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls") pod "dns-default-8llmk" (UID: "ed48d0ae-a851-40ae-89cc-03cd70d91da4") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:54.534217 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534115    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:54.534217 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534126    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c697d468-vwwrx: secret "image-registry-tls" not found
Oct 30 20:38:54.534217 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534165    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls podName:431fae52-1d80-468d-bdc3-cab61bc318ad nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.534146881 +0000 UTC m=+46.705399956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls") pod "image-registry-c697d468-vwwrx" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad") : secret "image-registry-tls" not found
Oct 30 20:38:54.534384 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534224    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:54.534384 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.534255    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls podName:4ea22bf5-fa1a-46e5-9a03-002f5086b4fa nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.534245437 +0000 UTC m=+46.705498514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-gcjn9" (UID: "4ea22bf5-fa1a-46e5-9a03-002f5086b4fa") : secret "samples-operator-tls" not found
Oct 30 20:38:54.709405 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.709367    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv" event={"ID":"09ff4a44-54fe-4984-a650-5d182ee89e4c","Type":"ContainerStarted","Data":"cfaf22a19c2da2d61bfaa3dd7407f9e49eb930563ff250bcc54a26b5ba47d648"}
Oct 30 20:38:54.710757 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.710724    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk" event={"ID":"09460045-d0af-4ea6-8c50-e3516d295859","Type":"ContainerStarted","Data":"d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f"}
Oct 30 20:38:54.712658 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.712490    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr" event={"ID":"372fd9ae-8977-4e6b-999b-f95ef59b0a44","Type":"ContainerStarted","Data":"1edde464998c5b3ac09df8c904d95cc566ee50d4d16ea2b655d7df3a7f0c0323"}
Oct 30 20:38:54.712658 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.712560    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr" event={"ID":"372fd9ae-8977-4e6b-999b-f95ef59b0a44","Type":"ContainerStarted","Data":"fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a"}
Oct 30 20:38:54.714882 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.714858    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85qnr" event={"ID":"9c8823a4-a700-41c4-bb61-bc5144e9d1eb","Type":"ContainerStarted","Data":"ff693aede2631e3de3a3e6f58afa9038e8cb861c1064abbb74524cd03e39bb69"}
Oct 30 20:38:54.715001 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.714984    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:54.717713 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.717678    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" event={"ID":"23ea3055-97ae-427c-a023-3169446b3bae","Type":"ContainerStarted","Data":"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"}
Oct 30 20:38:54.717818 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.717719    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" event={"ID":"23ea3055-97ae-427c-a023-3169446b3bae","Type":"ContainerStarted","Data":"51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af"}
Oct 30 20:38:54.719794 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.719764    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz" event={"ID":"d40186c5-2e27-4466-9673-61b5de376741","Type":"ContainerStarted","Data":"6e2f5ca77c776955f1250b1a89bbe717018c5c9f8660a342fe9cb2cb37f3a20e"}
Oct 30 20:38:54.744326 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.738961    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr" podStartSLOduration=1.738943283 podStartE2EDuration="1.738943283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:54.734517074 +0000 UTC m=+38.905770154" watchObservedRunningTime="2026-10-30 20:38:54.738943283 +0000 UTC m=+38.910196367"
Oct 30 20:38:54.757238 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.757174    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" podStartSLOduration=1.7571535649999999 podStartE2EDuration="1.757153565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:54.755645937 +0000 UTC m=+38.926899019" watchObservedRunningTime="2026-10-30 20:38:54.757153565 +0000 UTC m=+38.928406649"
Oct 30 20:38:54.780866 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.780805    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-85qnr" podStartSLOduration=34.00013231 podStartE2EDuration="37.780786867s" totalImagesPullingTime="3.780654557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:54.779700551 +0000 UTC m=+38.950953638" watchObservedRunningTime="2026-10-30 20:38:54.780786867 +0000 UTC m=+38.952039954"
Oct 30 20:38:54.836222 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.836138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:54.836371 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:54.836344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:54.837548 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.836645    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:54.837548 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.836727    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.836703518 +0000 UTC m=+41.007956598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:54.837548 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.837270    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:54.837548 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:54.837324    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.837307215 +0000 UTC m=+41.008560288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:55.401085 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.400670    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz" podStartSLOduration=392.604754658 podStartE2EDuration="6m39.40064867s" totalImagesPullingTime="6.795894012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:54.802973399 +0000 UTC m=+38.974226480" watchObservedRunningTime="2026-10-30 20:38:55.40064867 +0000 UTC m=+39.571901754"
Oct 30 20:38:55.401085 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.400971    2577 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"]
Oct 30 20:38:55.401743 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:55.401689    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb" podUID="5372497c-4ed1-445c-966c-8693956a6b1e"
Oct 30 20:38:55.449908 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.448786    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:38:55.464206 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.464169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.475222 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.475155    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:38:55.550431 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550431 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550689 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550689 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550689 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550689 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550881 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.550881 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.550721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651310 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651654 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651778 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651706    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651778 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651894 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651894 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.651894 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.652040 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.652040 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.651984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.652682 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.652620    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.653056 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.653031    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.655723 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.655673    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.655912 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.655888    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.657694 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.657668    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.679109 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.679058    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.681058 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.681000    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.724873 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.724839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:55.747950 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.747798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:55.789681 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.789644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:55.854581 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.854545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.854752 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.854688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.854752 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.854740    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.854955 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.854934    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.855045 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.854989    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:55.855045 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855010    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.855138 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.855187 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855163    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\") pod \"5372497c-4ed1-445c-966c-8693956a6b1e\" (UID: \"5372497c-4ed1-445c-966c-8693956a6b1e\") "
Oct 30 20:38:55.855238 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855217    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:38:55.855473 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855459    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5372497c-4ed1-445c-966c-8693956a6b1e-ca-trust-extracted\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.855561 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855480    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-trusted-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.855561 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.855549    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:55.857689 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.857658    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:55.857846 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.857781    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:55.857976 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.857944    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:55.859866 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.859836    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6" pod "5372497c-4ed1-445c-966c-8693956a6b1e" (UID: "5372497c-4ed1-445c-966c-8693956a6b1e"). InnerVolumeSpecName "kube-api-access-vhsf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:55.956351 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.956312    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-installation-pull-secrets\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.956351 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.956348    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhsf6\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-kube-api-access-vhsf6\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.956578 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.956364    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5372497c-4ed1-445c-966c-8693956a6b1e-registry-certificates\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.956578 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.956380    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5372497c-4ed1-445c-966c-8693956a6b1e-image-registry-private-configuration\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:55.956578 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:55.956397    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-bound-sa-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:56.125572 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.125537    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:38:56.161760 ip-10-0-135-104 kubenswrapper[2577]: W1030 20:38:56.161693    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf9b7c1_d0db_411b_88ea_6ae6f1f03c7a.slice/crio-470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3 WatchSource:0}: Error finding container 470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3: Status 404 returned error can't find the container with id 470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3
Oct 30 20:38:56.274518 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.274488    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mx29f_b0892a92-0735-4167-b582-537e22ec72c4/dns-node-resolver/0.log"
Oct 30 20:38:56.730361 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.730315    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv" event={"ID":"09ff4a44-54fe-4984-a650-5d182ee89e4c","Type":"ContainerStarted","Data":"744c7a613b143d84d7eaa437176454e2c64291c863e23bc6a4d0c203c9d6901d"}
Oct 30 20:38:56.732418 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.732385    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" event={"ID":"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a","Type":"ContainerStarted","Data":"77ba4626dea8742baac7a57d5c33b5e0b033477f921b4ed4277a2560c64bf01c"}
Oct 30 20:38:56.732596 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.732443    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" event={"ID":"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a","Type":"ContainerStarted","Data":"470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3"}
Oct 30 20:38:56.732664 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.732612    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:56.734270 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.734246    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk" event={"ID":"09460045-d0af-4ea6-8c50-e3516d295859","Type":"ContainerStarted","Data":"795ea596ee175317a755fcb414f789b5e364bd35fba6926698866304660eaff0"}
Oct 30 20:38:56.734366 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.734354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"
Oct 30 20:38:56.752645 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.752584    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv" podStartSLOduration=1.68967388 podStartE2EDuration="3.752562919s" totalImagesPullingTime="2.062889039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:56.75076083 +0000 UTC m=+40.922013913" watchObservedRunningTime="2026-10-30 20:38:56.752562919 +0000 UTC m=+40.923816003"
Oct 30 20:38:56.771471 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.771422    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk" podStartSLOduration=1.702351353 podStartE2EDuration="3.771410374s" totalImagesPullingTime="2.069059021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:56.770342313 +0000 UTC m=+40.941595396" watchObservedRunningTime="2026-10-30 20:38:56.771410374 +0000 UTC m=+40.942663456"
Oct 30 20:38:56.866309 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.866271    2577 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"]
Oct 30 20:38:56.870293 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.870267    2577 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54cdf9fc8f-nf6xb"]
Oct 30 20:38:56.870784 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.870766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:56.870910 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.870893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:56.870953 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:56.870897    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:56.871012 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:56.870992    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:56.871085 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:56.871006    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:00.870988152 +0000 UTC m=+45.042241217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:56.871155 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:56.871106    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:00.871085812 +0000 UTC m=+45.042338875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:56.907216 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.907154    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" podStartSLOduration=1.9071347109999999 podStartE2EDuration="1.907134711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:56.905687521 +0000 UTC m=+41.076940603" watchObservedRunningTime="2026-10-30 20:38:56.907134711 +0000 UTC m=+41.078387793"
Oct 30 20:38:56.972064 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:56.971979    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5372497c-4ed1-445c-966c-8693956a6b1e-registry-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:57.003926 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.003871    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:57.004116 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.003953    2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:57.004436 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.004411    2577 scope.go:122] "RemoveContainer" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"
Oct 30 20:38:57.004695 ip-10-0-135-104 kubenswrapper[2577]: E1030 20:38:57.004673    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:38:57.074132 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.074098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wb5s_514248b1-0652-4a5a-bc20-74442c71b232/node-ca/0.log"
Oct 30 20:38:57.674479 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.674410    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmw72_07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/serve-healthcheck-canary/0.log"
Oct 30 20:38:57.875268 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:57.875233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-fb5nk_09460045-d0af-4ea6-8c50-e3516d295859/migrator/0.log"
Oct 30 20:38:58.075162 ip-10-0-135-104 kubenswrapper[2577]: I1030 20:38:58.075123    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-z4gcv_09ff4a44-54fe-4984-a650-5d182ee89e4c/migrator/0.log"
Oct 30 20:38:58.115556 ip-10-0-135-104 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:38:58.135239 ip-10-0-135-104 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:38:58.135404 ip-10-0-135-104 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:38:58.135453 ip-10-0-135-104 systemd[1]: kubelet.service: Consumed 3.316s CPU time.
Oct 30 20:38:58.149080 ip-10-0-135-104 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:58.272147 ip-10-0-135-104 kubenswrapper[5115]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:58.272147 ip-10-0-135-104 kubenswrapper[5115]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:58.272147 ip-10-0-135-104 kubenswrapper[5115]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:58.272147 ip-10-0-135-104 kubenswrapper[5115]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:58.274246 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274156    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.274246 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274245    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.274246 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274250    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274254    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274257    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274260    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274263    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274266    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274269    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274272    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274274    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274278    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274280    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274283    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274285    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274288    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274291    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274293    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274296    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274299    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274301    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274304    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.274344 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274307    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274317    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274320    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274323    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274326    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274328    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274331    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274333    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274337    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274339    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274342    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274345    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274347    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274350    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274353    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274356    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274359    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274362    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274364    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.274869 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274367    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274369    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274372    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274374    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274377    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274379    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274382    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274385    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274387    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274390    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274392    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274396    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274398    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274401    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274404    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274406    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274409    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274411    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274414    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.275386 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274416    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274419    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274422    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274424    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274427    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274430    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274433    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274436    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274439    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274441    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274444    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274448    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274452    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274456    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274460    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274462    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274465    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274468    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274470    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.275893 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274473    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274476    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274479    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274481    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274484    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274487    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274490    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274493    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274496    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274498    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274501    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274503    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274506    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274508    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274511    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274514    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274516    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274520    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274538    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.276376 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274542    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274545    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274548    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274550    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274554    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274557    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274560    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.274562    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275318    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275325    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275328    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275332    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275334    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275337    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275339    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275342    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275345    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275348    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275351    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.276891 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275353    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275357    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275360    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275363    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275365    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275368    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275371    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275373    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275376    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275378    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275381    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275383    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275386    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275389    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275392    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275395    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275398    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275400    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275403    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275406    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.277371 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275408    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275411    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275414    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275416    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275419    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275421    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275424    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275427    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275429    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275433    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275436    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275438    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275441    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275444    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275447    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275450    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275452    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275455    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275457    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275460    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.277894 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275462    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275465    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275467    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275471    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275473    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275476    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275479    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275481    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275484    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275487    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275490    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275492    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275495    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275498    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275501    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275504    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275506    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275509    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275511    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275514    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.278396 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275517    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275519    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275537    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275540    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275543    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275546    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275549    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275551    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275554    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275557    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275559    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275562    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275566    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275570    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275574    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275579    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275582    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275586    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275589    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.278934 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275591    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275594    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275597    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275600    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275602    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275605    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275607    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275610    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275613    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275615    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275618    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275620    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275623    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275626    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275628    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.275631    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276122    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276127    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276130    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.279402 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276133    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276138    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276141    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276145    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276148    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276151    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276154    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276156    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276159    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276163    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276165    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276168    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276171    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276174    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276176    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276179    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276182    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276184    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276187    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.279892 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276190    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276192    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276195    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276198    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276200    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276202    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276205    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276207    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276210    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276213    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276220    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276222    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276225    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276228    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276231    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276233    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276236    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276238    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276241    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276243    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.280404 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276246    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276249    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276251    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276254    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276256    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276259    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276261    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276264    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276267    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276269    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276272    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276274    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276277    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276279    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276282    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276286    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276289    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276292    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276295    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276297    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.280979 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276300    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276302    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276308    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276311    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276314    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276317    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276320    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276322    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276325    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276327    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276330    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276332    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276335    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276338    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276340    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276342    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276345    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276347    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276350    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.281467 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276353    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276355    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276358    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276361    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276364    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276367    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276369    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276372    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276374    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276378    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276381    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276384    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276386    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276389    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276392    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276396    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276399    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276402    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276404    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276407    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.281960 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276410    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276412    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276415    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276417    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.276420    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276536    5115 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276551    5115 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276557    5115 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276562    5115 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276566    5115 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276569    5115 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276574    5115 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276578    5115 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276581    5115 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276585    5115 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276588    5115 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276592    5115 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276596    5115 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276599    5115 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276602    5115 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276605    5115 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276608    5115 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276611    5115 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276618    5115 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:58.282442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276621    5115 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276624    5115 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276627    5115 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276632    5115 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276636    5115 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276640    5115 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276643    5115 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276647    5115 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276650    5115 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276653    5115 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276656    5115 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276659    5115 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276662    5115 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276667    5115 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276670    5115 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276673    5115 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276676    5115 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276680    5115 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276683    5115 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276687    5115 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276690    5115 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276694    5115 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276697    5115 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276700    5115 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:58.283032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276704    5115 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276707    5115 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276711    5115 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276714    5115 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276717    5115 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276721    5115 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276723    5115 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276728    5115 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276731    5115 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276735    5115 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276737    5115 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276743    5115 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276746    5115 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276750    5115 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276753    5115 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276757    5115 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276760    5115 flags.go:64] FLAG: --help="false"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276763    5115 flags.go:64] FLAG: --hostname-override="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276767    5115 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276770    5115 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276773    5115 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276776    5115 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276780    5115 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:58.283646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276783    5115 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276786    5115 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276789    5115 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276792    5115 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276795    5115 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276798    5115 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276801    5115 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276804    5115 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276807    5115 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276811    5115 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276813    5115 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276816    5115 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276819    5115 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276822    5115 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276825    5115 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276831    5115 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276836    5115 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276839    5115 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276842    5115 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276845    5115 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276850    5115 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276853    5115 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276856    5115 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276861    5115 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276864    5115 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:58.284212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276870    5115 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276873    5115 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276876    5115 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276879    5115 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276882    5115 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276885    5115 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276888    5115 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276891    5115 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276898    5115 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276902    5115 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276905    5115 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276908    5115 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276911    5115 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276914    5115 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276917    5115 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276920    5115 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276923    5115 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276926    5115 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0aeb67e388644be10"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276929    5115 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276933    5115 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276936    5115 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276939    5115 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276942    5115 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276947    5115 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276950    5115 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276961    5115 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:58.284864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276970    5115 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276973    5115 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276977    5115 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276980    5115 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276983    5115 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276986    5115 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276989    5115 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276993    5115 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276996    5115 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.276999    5115 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277002    5115 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277005    5115 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277008    5115 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277011    5115 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277014    5115 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277017    5115 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277019    5115 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277023    5115 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277025    5115 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277028    5115 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277034    5115 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277036    5115 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277039    5115 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277049    5115 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277052    5115 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:58.285828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277055    5115 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277058    5115 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277061    5115 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277064    5115 flags.go:64] FLAG: --v="2"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277075    5115 flags.go:64] FLAG: --version="false"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277079    5115 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277083    5115 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277086    5115 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277262    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277266    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277269    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277272    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277275    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277279    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277282    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277285    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277288    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277291    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277293    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277296    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277299    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.286748 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277301    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277304    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277306    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277309    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277312    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277315    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277318    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277320    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277323    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277326    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277328    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277331    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277333    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277336    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277338    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277342    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277345    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277348    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277350    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277353    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.287268 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277355    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277358    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277360    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277363    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277365    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277368    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277371    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277374    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277377    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277380    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277382    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277385    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277388    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277390    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277393    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277395    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277398    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277401    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277403    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.287877 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277406    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277408    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277411    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277413    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277416    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277418    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277421    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277424    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277428    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277430    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277434    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277437    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277440    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277443    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277445    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277448    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277451    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277453    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277456    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277458    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.288747 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277461    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277464    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277467    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277469    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277472    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277474    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277477    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277481    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277485    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277488    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277491    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277493    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277496    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277499    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277501    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277504    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277506    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277509    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277511    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277514    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.289540 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277518    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277533    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277538    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277540    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277543    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277546    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277549    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277551    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277554    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277557    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277559    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277562    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277564    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277567    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.277602    5115 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277644    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.290095 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277648    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277652    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277655    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277658    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277660    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277663    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277666    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277668    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277671    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277674    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277677    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277679    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277682    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277685    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277688    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277691    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277695    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277697    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277701    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277706    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.290603 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277709    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277712    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277714    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277717    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277720    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277723    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277725    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277728    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277730    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277733    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277736    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277739    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277741    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277744    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277747    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277749    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277752    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277754    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277757    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277759    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.291222 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277762    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277764    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277767    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277769    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277772    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277775    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277777    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277780    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277783    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277786    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277789    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277792    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277795    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277798    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277800    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277803    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277805    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277809    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277811    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.291842 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277814    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277816    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277819    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277821    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277824    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277827    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277830    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277833    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277835    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277838    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277840    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277843    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277845    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277849    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277854    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277857    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277860    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277862    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277865    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.292406 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277867    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277870    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277874    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277877    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277879    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277883    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277886    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277889    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277891    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277894    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277897    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277900    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277902    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277905    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277908    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277911    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277913    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277916    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277919    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277922    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.292913 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277924    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277927    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277929    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277932    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277935    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277937    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.277942    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.282057    5115 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.282074    5115 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.282089    5115 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.282098    5115 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282171    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282176    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282180    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282184    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282189    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282192    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282195    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.293437 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282198    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282201    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282203    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282206    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282209    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282211    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282214    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282217    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282220    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282222    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282225    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282227    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282230    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282233    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282236    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282239    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282241    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282244    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282247    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282250    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.294114 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282252    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282255    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282264    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282266    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282269    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282272    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282274    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282277    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282279    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282282    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282284    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282287    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282289    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282292    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282295    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282298    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282300    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282303    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282306    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282308    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.294655 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282311    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282314    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282316    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282319    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282321    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282324    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282327    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282330    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282333    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282336    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282339    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282342    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282344    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282347    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282349    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282357    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282360    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282368    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282372    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282374    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.295148 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282377    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282380    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282383    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282385    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282388    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282390    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282393    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282395    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282398    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282400    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282403    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282405    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282408    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282410    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282413    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282416    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282419    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282422    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282424    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.295714 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282427    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282430    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282432    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282435    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282438    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282440    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282443    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282446    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282449    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282457    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282460    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282462    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282465    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282468    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282470    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282473    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282475    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282478    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282480    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.296201 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282483    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.282509    5115 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282704    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282709    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282714    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282716    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282719    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282722    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282725    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282730    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282733    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282736    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282740    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282744    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282747    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.296733 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282749    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282752    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282754    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282757    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282759    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282762    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282764    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282767    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282775    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282778    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282780    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282783    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282786    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282788    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282790    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282793    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282796    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282798    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282801    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282804    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.297120 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282806    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282809    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282812    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282814    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282817    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282819    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282822    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282824    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282827    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282829    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282832    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282835    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282837    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282840    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282842    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282845    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282848    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282850    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282853    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282855    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.297709 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282858    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282866    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282869    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282871    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282874    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282876    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282879    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282884    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282886    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282889    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282891    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282894    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282897    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282900    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282902    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282905    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282908    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282910    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282913    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.298387 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282915    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282918    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282920    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282923    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282926    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282928    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282931    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282933    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282936    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282938    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282941    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282943    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282946    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282949    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282951    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282960    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282963    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282966    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282969    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.298888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282971    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282976    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282978    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282981    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282983    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282986    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282989    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282991    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282994    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282996    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.282999    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283001    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283004    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283006    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283009    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.283032    5115 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:58.299420 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283075    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283079    5115 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283082    5115 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283085    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283088    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283091    5115 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283093    5115 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283096    5115 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283098    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283101    5115 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283104    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283106    5115 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283109    5115 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283117    5115 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283120    5115 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283122    5115 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283125    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283128    5115 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283131    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:58.299883 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283134    5115 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283136    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283139    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283143    5115 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283147    5115 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283150    5115 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283152    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283156    5115 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283160    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283163    5115 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283166    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283169    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283171    5115 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283174    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283176    5115 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283178    5115 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283181    5115 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283184    5115 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:58.300341 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283186    5115 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283189    5115 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283191    5115 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283194    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283196    5115 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283199    5115 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283201    5115 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283204    5115 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283206    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283215    5115 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283218    5115 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283221    5115 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283224    5115 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283227    5115 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283230    5115 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283232    5115 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283235    5115 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283237    5115 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283240    5115 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283242    5115 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:58.300803 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283245    5115 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283248    5115 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283250    5115 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283253    5115 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283255    5115 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283258    5115 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283260    5115 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283263    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283265    5115 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283268    5115 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283270    5115 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283273    5115 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283276    5115 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283278    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283281    5115 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283283    5115 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283289    5115 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283292    5115 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283300    5115 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283303    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:58.301288 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283305    5115 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283308    5115 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283319    5115 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283322    5115 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283325    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283328    5115 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283330    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283333    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283335    5115 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283338    5115 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283340    5115 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283343    5115 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283345    5115 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283348    5115 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283351    5115 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283354    5115 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283357    5115 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283359    5115 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283362    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283364    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:58.301795 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283367    5115 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283369    5115 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283372    5115 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283374    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283377    5115 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283379    5115 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283382    5115 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283384    5115 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:58.283387    5115 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.283453    5115 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.284504    5115 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.284569    5115 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.284764    5115 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.284906    5115 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.284953    5115 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:16 +0000 UTC" deadline="2028-05-11 13:51:42.032059485 +0000 UTC"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.285021    5115 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13409h12m43.747040965s"
Oct 30 20:38:58.302275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.285956    5115 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:58.302687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.287849    5115 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:58.302687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.289261    5115 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:58.302687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.291159    5115 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:58.302687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.292012    5115 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:58.302687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.294065    5115 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 917ce37a-fe24-46be-8ed4-75f345230c41:/dev/nvme0n1p4 ad045db8-ad3c-4088-a124-f3280a342a98:/dev/nvme0n1p3]
Oct 30 20:38:58.302851 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.294087    5115 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ede4b8157e7e694a7a392054d68cd1dcb929414507b3c162ee7822c87ab4e22/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ede4b8157e7e694a7a392054d68cd1dcb929414507b3c162ee7822c87ab4e22/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3/userdata/shm major:0 minor:377 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af/userdata/shm major:0 minor:316 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5266bcb6302630209cfd53396565f8f75e6aa9e3876093466dc0076a890b60e0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5266bcb6302630209cfd53396565f8f75e6aa9e3876093466dc0076a890b60e0/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69c12c120aa6c5af1e7f0aefe1e771836c96d61a6d4b80be518a47d9f754fc93/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69c12c120aa6c5af1e7f0aefe1e771836c96d61a6d4b80be518a47d9f754fc93/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a1d1a5bbea5ad4e57b9e02bf10d654b2c48284c5a5fe6106b501f2bb20789c03/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a1d1a5bbea5ad4e57b9e02bf10d654b2c48284c5a5fe6106b501f2bb20789c03/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cfaf22a19c2da2d61bfaa3dd7407f9e49eb930563ff250bcc54a26b5ba47d648/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cfaf22a19c2da2d61bfaa3dd7407f9e49eb930563ff250bcc54a26b5ba47d648/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99/volumes/kubernetes.io~projected/kube-api-access-f2k8l:{mountpoint:/var/lib/kubelet/pods/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99/volumes/kubernetes.io~projected/kube-api-access-f2k8l major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~projected/kube-api-access-4srqc:{mountpoint:/var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~projected/kube-api-access-4srqc major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09460045-d0af-4ea6-8c50-e3516d295859/volumes/kubernetes.io~projected/kube-api-access-5s2rd:{mountpoint:/var/lib/kubelet/pods/09460045-d0af-4ea6-8c50-e3516d295859/volumes/kubernetes.io~projected/kube-api-access-5s2rd major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09ff4a44-54fe-4984-a650-5d182ee89e4c/volumes/kubernetes.io~projected/kube-api-access-2smsw:{mountpoint:/var/lib/kubelet/pods/09ff4a44-54fe-4984-a650-5d182ee89e4c/volumes/kubernetes.io~projected/kube-api-access-2smsw major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12625149-ab99-482a-8617-4ef8fe1b541a/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/12625149-ab99-482a-8617-4ef8fe1b541a/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22d96d38-8111-4e17-9bcf-14205835c57c/volumes/kubernetes.io~projected/kube-api-access-g8t6t:{mountpoint:/var/lib/kubelet/pods/22d96d38-8111-4e17-9bcf-14205835c57c/volumes/kubernetes.io~projected/kube-api-access-g8t6t major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23ea3055-97ae-427c-a023-3169446b3bae/volumes/kubernetes.io~projected/kube-api-access-z6jzk:{mountpoint:/var/lib/kubelet/pods/23ea3055-97ae-427c-a023-3169446b3bae/volumes/kubernetes.io~projected/kube-api-access-z6jzk major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~projected/kube-api-access-8rljt:{mountpoint:/var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~projected/kube-api-access-8rljt major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~secret/signing-key major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:375 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/kube-api-access-d8rgs:{mountpoint:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/kube-api-access-d8rgs major:0 minor:376 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/registry-tls major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~projected/kube-api-access-c5wkh:{mountpoint:/var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~projected/kube-api-access-c5wkh major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~secret/serving-cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/kube-api-access-6zfgc:{mountpoint:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/kube-api-access-6zfgc major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/44d448e2-3ecb-4f8e-a8a9-9220518c481c/volumes/kubernetes.io~projected/kube-api-access-wd7cz:{mountpoint:/var/lib/kubelet/pods/44d448e2-3ecb-4f8e-a8a9-9220518c481c/volumes/kubernetes.io~projected/kube-api-access-wd7cz major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa/volumes/kubernetes.io~projected/kube-api-access-mbvvz:{mountpoint:/var/lib/kubelet/pods/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa/volumes/kubernetes.io~projected/kube-api-access-mbvvz major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50d8f3d8-875f-413d-996a-a4a68910b7fd/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/50d8f3d8-875f-413d-996a-a4a68910b7fd/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/514248b1-0652-4a5a-bc20-74442c71b232/volumes/kubernetes.io~projected/kube-api-access-h25v9:{mountpoint:/var/lib/kubelet/pods/514248b1-0652-4a5a-bc20-74442c71b232/volumes/kubernetes.io~projected/kube-api-access-h25v9 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/539bc22b-62ae-4c20-8d54-8f57f0603995/volumes/kubernetes.io~projected/kube-api-access-8vkhg:{mountpoint:/var/lib/kubelet/pods/539bc22b-62ae-4c20-8d54-8f57f0603995/volumes/kubernetes.io~projected/kube-api-access-8vkhg major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50/volumes/kubernetes.io~projected/kube-api-access-mmkbv:{mountpoint:/var/lib/kubelet/pods/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50/volumes/kubernetes.io~projected/kube-api-access-mmkbv major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/590ec5f5-833c-45d4-aec7-1d3409d62913/volumes/kubernetes.io~projected/kube-api-access-jk8q2:{mountpoint:/var/lib/kubelet/pods/590ec5f5-833c-45d4-aec7-1d3409d62913/volumes/kubernetes.io~projected/kube-api-access-jk8q2 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7/volumes/kubernetes.io~projected/kube-api-access-nhlls:{mountpoint:/var/lib/kubelet/pods/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7/volumes/kubernetes.io~projected/kube-api-access-nhlls major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~projected/kube-api-access-m5846:{mountpoint:/var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~projected/kube-api-access-m5846 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~secret/serving-cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78825b89-4bdd-4e7c-b145-e3f5b3eab767/volumes/kubernetes.io~projected/kube-api-access-wjk8j:{mountpoint:/var/lib/kubelet/pods/78825b89-4bdd-4e7c-b145-e3f5b3eab767/volumes/kubernetes.io~projected/kube-api-access-wjk8j major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~projected/kube-api-access-d8brj:{mountpoint:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~projected/kube-api-access-d8brj major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/stats-auth major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~projected/kube-api-access-bdc6n:{mountpoint:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~projected/kube-api-access-bdc6n major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~projected/kube-api-access-wwbw4:{mountpoint:/var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~projected/kube-api-access-wwbw4 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9c8823a4-a700-41c4-bb61-bc5144e9d1eb/volumes/kubernetes.io~projected/kube-api-access-zjjvt:{mountpoint:/var/lib/kubelet/pods/9c8823a4-a700-41c4-bb61-bc5144e9d1eb/volumes/kubernetes.io~projected/kube-api-access-zjjvt major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9da979e4-86df-4578-8761-5fdf0ba9da9c/volumes/kubernetes.io~projected/kube-api-access-8fp5n:{mountpoint:/var/lib/kubelet/pods/9da979e4-86df-4578-8761-5fdf0ba9da9c/volumes/kubernetes.io~projected/kube-api-access-8fp5n major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a99477a2-e4e4-4608-a66e-00009ec9f50d/volumes/kubernetes.io~projected/kube-api-access-57q8t:{mountpoint:/var/lib/kubelet/pods/a99477a2-e4e4-4608-a66e-00009ec9f50d/volumes/kubernetes.io~projected/kube-api-access-57q8t major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0892a92-0735-4167-b582-537e22ec72c4/volumes/kubernetes.io~projected/kube-api-access-4vdqx:{mountpoint:/var/lib/kubelet/pods/b0892a92-0735-4167-b582-537e22ec72c4/volumes/kubernetes.io~projected/kube-api-access-4vdqx major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~projected/kube-api-access-nsq29:{mountpoint:/var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~projected/kube-api-access-nsq29 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~projected/kube-api-access-kr777:{mountpoint:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~projected/kube-api-access-kr777 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d40186c5-2e27-4466-9673-61b5de376741/volumes/kubernetes.io~projected/kube-api-access-rzgpn:{mountpoint:/var/lib/kubelet/pods/d40186c5-2e27-4466-9673-61b5de376741/volumes/kubernetes.io~projected/kube-api-access-rzgpn major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed48d0ae-a851-40ae-89cc-03cd70d91da4/volumes/kubernetes.io~projected/kube-api-access-gcrq9:{mountpoint:/var/lib/kubelet/pods/ed48d0ae-a851-40ae-89cc-03cd70d91da4/volumes/kubernetes.io~projected/kube-api-access-gcrq9 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5/volumes/kubernetes.io~projected/kube-api-access-9lhxf:{mountpoint:/var/lib/kubelet/pods/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5/volumes/kubernetes.io~projected/kube-api-access-9lhxf major:0 minor:61 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/ffca1c2a0708f29271b3917049642ce10ddfa5b6951888915bc11186cb7a3db6/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/0a5c3a037a9a16e6d59fb72f59e45b84033579c78c528e5758489fb30de00614/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/6d4bbb81a588f1b086ad2a4af3c6e1482cd97909053a2069707e105748ee8b23/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/d29bb1030aed3297ce39f9ebd2299272ae80b12095b727fc619df2ba051f2966/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/483930464c7d2b9774a6f2cf9172ca93bd0670df4e1af88b61106333237ec255/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4a1e19cdde03facec97bb68a8369fa8de087153f5a49ec47375be2a04b82c395/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/d51d4ba93a1ded8b94f50049a42fe1dfa37b89f2dac7e070dc636c325caec82b/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8bb76cccf99d896de80e7b704ddd4d1468a1a09aa6b0b13606923e20355e26a3/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/64465d94ec1a6b091ec2e2de04e5815e6cf2364f85073bfbc75477ab40f608fd/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/251386b16e3dbcea9efc7724585a8af8aea3661a6604f9a51a2fed62cdf665e9/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/c9c13690194a15995cc7296fcf0ac50ec83b554a8fe6af6cb7be11342aeef520/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/2f4781886d035b60ca95a0076a1631209f901e9359a7ed027f4f1a4c1ec1242f/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/20dd36096f7e3f6df49df7e72bfb32b7f3c6e9f48f7640aa4c2a9a058673330c/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cfea71108d2203e6bba4d053173ba66bfcb6f55d97a30d1e4ee5dff68c40d317/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/b4f93d8788594d43e268ccfabfbb5009cae2beda6bad60652112742e39d4b0f9/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-169:{mountpoint:/var/lib/containers/storage/overlay/e510afc422d0712d8c84f2faf16c99e57df6e22c26c00f6944b7ef1c39e5bb5b/merged major:0 minor:169 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/2af6463be397a8f2e139cd9ae364d4201255085ef4f81521bafdbd7e14dda0c4/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/a16ff98127a0f4bf43283b4b5aa355c23b40365f28a921f9807d1e04778f4857/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/8ba4ac117e293449b058ff0bbf34c097a586ee83ede5eaedd681c4f345c3fe88/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e5bb76b037f745ba3dca609adc598cb0dc2566505384807cf8aa2804a67121f0/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/345cdd61f90caab9d067ec243a8fbcd9a23fc743a1287ebe15578d6bc63f08e2/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-205:{mountpoint:/var/lib/containers/storage/overlay/67d907244bba2d2eb269da47dbe1be64881692759d70e8adf25fdf6a7dd8d145/merged major:0 minor:205 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/55b1b34238fc31028e022920f46a1063e442ba81da3972add39d863f6e6fcd07/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/92ada90aea19a2e074087e370b0b0ace991623e33c990f9b3133c436568107c0/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/e4e481f6657aa13f73031c2dcb6e1470065786dc4e8c7a29ec6b2ceab87cdaa2/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/48660601b51315eae58e01e59e73ee71955661dc0ab142d3f5411bd2775c4515/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/d0d9fd8fca5ea7635d3d8720106d7c8cf8d2eb584c6bec0be882904c18041181/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/8621538846b64b213a8bedfc86da7f174fe558b734ba12688d2d6ef403b446e3/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/ee5657ce5118fa1d68e65e61d9b5c22c1996a4f2173c2e0176f1d03fd73dc7b2/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/bbfa44e0f664142ed7bc4f122df5ce54604e07ddb449cc21fcf2f79d4f7e0e3a/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/6e25dfe101675166d13083e5b562688b978425519046244a683afc8c0209bbaa/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/6c29cb33085ed0f28b90862bb220438378a5d11a26fd29b0ed312e01b8f79afe/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/6a1e482b241ee47c537722234a63a90146550fea99a176309ee8c93d178008e0/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/3e50331cb9b75ed1db5a5d0efd150943b0fc0ae30bfdac9a0c3ff53f56cbdbf7/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/1c5f4821114fb0e3e5328c87de0ca56be74e3e5769fe458580431051819898ef/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/5e50707c538dd35de4d0054fb9982108bdc0ff0078658540757de08da4a2b436/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/a760d5e28acb083e635f5424adb0fb74117ebee4612cff3944241a403f346421/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/1378529a6fbfd1088ad5adcd24cddd7c93ae4075e53c53feb86477879bdd35be/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/d1665f3713687584cb40050e1b24d413f4e3b907a76dafeaf1e78e0d67622dfe/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/ba890bf1a855c3f6d738d0aaeaff2642317e802e593f8762302ab75b090ed527/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/4590669e6593ab046c0fff07c6db6a6ebebd8cb9affd79d73bcbcbc8c66a2c04/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/481435e914c164a09227a4bcd67df1d4f3321bd1b6c35f7f466177f87e21c508/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/f2aac13d79674cdcc672fd45c0b832f12ba06c09738a0adc51d93c7defcff66c/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/6fa6629e636f6f13c20aae7bb47945a6b191b4441f37099ae6b3efceaf9f2320/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/561303b3eca49bc4da2847139efbed1f6ed184b0f85d53166ebfe1b2cdffa0f5/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/58bff0f1086f21036301911d42bda096e2e91bb7b733fb7335b6e9664c415994/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/006e35028a203107d8cb2e2aee31aecd86371dc105f9078d26d7836d428de86b/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/6f2a7ef1a390fe41ed189414e98facae4d1e07f1a55694fcf3db4995437df8a9/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/6531cb98b24e8e32c200ccecc64a3d5895998958e85252a753483e11ba05aeb5/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/705dd0a46e47fc12530da9c552c97bc5e8c9034ca2ea412004993c50b2e1d45e/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/a1814b5f341386f4cb2b717433e8ebd59b1f4b3024226b0000dfb9f0c4077424/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/92153fb6f2a6d1d6e63a4db9176933d246bc99b9de2d4b7cef50e027a360101f/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/09c1217d1a7a172a1b2e8159f0be5d129d128bec028812ded93332a6ca97fdc7/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/7db2e06b948f11a405bbd137f3713a4b8cdf254be65929f33e04bb6dbb8ce671/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/0516025c4e7a847abb1b6affc32d0f04760a392f8229a94a09780f320ddd763e/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/74853a60ebeff9a99ab3e00176e432afc58557ba98384152279a54d245adbdfc/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/27e7fc2ef70e25d784cd48567418380ea7fd8fd7cc31be1e9a41af46adddea2e/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ca3fd05c95491e6c5fb7ecd89028a6a37a3e7c4647d675750cac926fe7a905a2/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-77:{mountpoint:/var/lib/containers/storage/overlay/d682d3cf99e3226ad2b31322050255abac6a0ce003413ca943baa338092d4417/merged major:0 minor:77 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/9ee5ad8a68fbfbbb587abc7d0067cecfcd2b6ed9f20d2b76461522d3f332b381/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/df002d2bc9761f309bf5b82b9ce77a03b44c69acf395f8e443f22d95d36b9fc0/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/abdb3ff59d155ff977ce4a23a59903ae72d9f537ff38f7639499f1d4c2c3af1a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/21f39a6fe8b8b4403d83f45eb76c9024b55437b7ec10f9b2718997549a6b4b99/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/68f04d0bea3d6fd8ebc436ee2a1a186e4128833d317002518566c08dd157cf54/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:38:58.303076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.302369    5115 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:58.301702514 +0000 UTC m=+0.105597261 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099767 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a07072e3a366873f07bfac83150d SystemUUID:ec28a070-72e3-a366-873f-07bfac83150d BootID:04b799f7-2846-4ed6-90e8-bcd543d5d202 Filesystems:[{Device:/var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~projected/kube-api-access-wwbw4 DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:373 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:374 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-77 DeviceMajor:0 DeviceMinor:77 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e97673201389ffc3301f5b8915258ca2e64aa6197899c3caf2aa8261e517115/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/50d8f3d8-875f-413d-996a-a4a68910b7fd/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:276 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/22d96d38-8111-4e17-9bcf-14205835c57c/volumes/kubernetes.io~projected/kube-api-access-g8t6t DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1b2ed9d34345ab83ba801913c822a30fd6cae46bdc9bd0a8fe3279a5cdb1c284/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69c12c120aa6c5af1e7f0aefe1e771836c96d61a6d4b80be518a47d9f754fc93/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:330 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d0a2441cf21ab3a6d7a5362cad4144bfdd045bc135d7d1c23b1059190229839f/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5/volumes/kubernetes.io~projected/kube-api-access-9lhxf DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~projected/kube-api-access-d8brj DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/683ccdf12b057a8a2d0383924b3fd035dc2900e629677a448d366109683cc76e/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b3d4b2d8ed86c852608e191ce7c8ad4de20f6963a5b92ce5ae1f044fba997949/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa/volumes/kubernetes.io~projected/kube-api-access-mbvvz DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a99477a2-e4e4-4608-a66e-00009ec9f50d/volumes/kubernetes.io~projected/kube-api-access-57q8t DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/78825b89-4bdd-4e7c-b145-e3f5b3eab767/volumes/kubernetes.io~projected/kube-api-access-wjk8j DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~projected/kube-api-access-nsq29 DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/23ea3055-97ae-427c-a023-3169446b3bae/volumes/kubernetes.io~projected/kube-api-access-z6jzk DeviceMajor:0 DeviceMinor:315 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/514248b1-0652-4a5a-bc20-74442c71b232/volumes/kubernetes.io~projected/kube-api-access-h25v9 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/539bc22b-62ae-4c20-8d54-8f57f0603995/volumes/kubernetes.io~projected/kube-api-access-8vkhg DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8733fa9ee5839c4f80d0f1b5bbee2a35934bd678c7a49cc4dd6347160943acb8/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~projected/kube-api-access-4srqc DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a1d1a5bbea5ad4e57b9e02bf10d654b2c48284c5a5fe6106b501f2bb20789c03/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5266bcb6302630209cfd53396565f8f75e6aa9e3876093466dc0076a890b60e0/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~projected/kube-api-access-bdc6n DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b0892a92-0735-4167-b582-537e22ec72c4/volumes/kubernetes.io~projected/kube-api-access-4vdqx DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7/volumes/kubernetes.io~projected/kube-api-access-nhlls DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/876aecfc-cf95-4ebc-8161-c89868e64e8d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/991c5e396e92d0659966f7319bfa7cc6ef3f07ddf21e5f57b7fea7f018ea83d8/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/kube-api-access-d8rgs DeviceMajor:0 DeviceMinor:376 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~projected/kube-api-access-kr777 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/44d448e2-3ecb-4f8e-a8a9-9220518c481c/volumes/kubernetes.io~projected/kube-api-access-wd7cz DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9da979e4-86df-4578-8761-5fdf0ba9da9c/volumes/kubernetes.io~projected/kube-api-access-8fp5n DeviceMajor:0 DeviceMinor:306 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/09460045-d0af-4ea6-8c50-e3516d295859/volumes/kubernetes.io~projected/kube-api-access-5s2rd DeviceMajor:0 DeviceMinor:333 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d191e269f6e88165502488fa4147d69331faf01c6f185f0386d41f374ada616/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/372fd9ae-8977-4e6b-999b-f95ef59b0a44/volumes/kubernetes.io~projected/kube-api-access-8rljt DeviceMajor:0 DeviceMinor:331 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b62c70f-47d9-4521-8e32-e5c65c0c7e87/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8549b448ba55a57e878e831ec42a879278f61de84800a522ff1fc5f19a87054/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e142fc785c03e7928f44c642fd2f95e3d28b8659a7ae7d91fbde1cd48dff446/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/09ff4a44-54fe-4984-a650-5d182ee89e4c/volumes/kubernetes.io~projected/kube-api-access-2smsw DeviceMajor:0 DeviceMinor:332 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:375 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3/userdata/shm DeviceMajor:0 DeviceMinor:377 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/590ec5f5-833c-45d4-aec7-1d3409d62913/volumes/kubernetes.io~projected/kube-api-access-jk8q2 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ede4b8157e7e694a7a392054d68cd1dcb929414507b3c162ee7822c87ab4e22/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7ce7223b712a93624496c914d4d390685742225f62cc901e7366984bf984ac1/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3e3625a5-852d-480b-a6e8-91ab6b2778b3/volumes/kubernetes.io~projected/kube-api-access-c5wkh DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74a76aa5dd04221efe038cfbd0305452481b7553279f5c29e29bd78663fd1c65/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:368 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed48d0ae-a851-40ae-89cc-03cd70d91da4/volumes/kubernetes.io~projected/kube-api-access-gcrq9 DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af/userdata/shm DeviceMajor:0 DeviceMinor:316 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/12625149-ab99-482a-8617-4ef8fe1b541a/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c8a35cdb-dc87-4e5e-8183-e42a6db8995f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50/volumes/kubernetes.io~projected/kube-api-access-mmkbv DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes/kubernetes.io~projected/kube-api-access-6zfgc DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/33927420441ef4a403952742a834175b5f268a248daa916ab4764c97f49c2386/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fdfaa30f4a7998af3c9de81bdcdb62b60192b8314d9649647c837c112ec04f5a/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9c8823a4-a700-41c4-bb61-bc5144e9d1eb/volumes/kubernetes.io~projected/kube-api-access-zjjvt DeviceMajor:0 DeviceMinor:293 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ce4b1301-6a55-465f-af3b-6e1113a45271/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9e32aa10f74cfebb3e47ea438a67dd63df0ec95c0ed5d587eb2daaa652a037c1/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-169 DeviceMajor:0 DeviceMinor:169 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/69b633d2-97d9-4a07-9506-45658f48ee49/volumes/kubernetes.io~projected/kube-api-access-m5846 DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d40186c5-2e27-4466-9673-61b5de376741/volumes/kubernetes.io~projected/kube-api-access-rzgpn DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/714855a2a6f1b4f43c90a7da50a802769b41cd5d72b6013272f8db7e1bf58d57/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cfaf22a19c2da2d61bfaa3dd7407f9e49eb930563ff250bcc54a26b5ba47d648/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99/volumes/kubernetes.io~projected/kube-api-access-f2k8l DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/51df481f50854a39ac634f364f3faa10a12004437974e8861192e90f584232ca/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b2ddf6ef1cb24c29f30aa7e1b71133a49df4f5ba77bf56ecd5b7fb652c31790/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/79fa788b-5742-40c8-9fa5-7e2cc2cd2005/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-205 DeviceMajor:0 DeviceMinor:205 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:1b2ed9d34345ab8 MacAddress:ce:bb:f5:f1:b8:6a Speed:10000 Mtu:8901} {Name:2e97673201389ff MacAddress:66:37:53:98:ee:f4 Speed:10000 Mtu:8901} {Name:33927420441ef4a MacAddress:92:05:e1:fb:ce:d8 Speed:10000 Mtu:8901} {Name:470a0f278fe8c95 MacAddress:76:b1:2f:2c:61:07 Speed:10000 Mtu:8901} {Name:51eeb2ca08de717 MacAddress:a6:c0:22:52:e8:db Speed:10000 Mtu:8901} {Name:5266bcb63026302 MacAddress:fe:7f:bd:c8:60:6b Speed:10000 Mtu:8901} {Name:5e142fc785c03e7 MacAddress:9e:6d:d4:fb:54:f1 Speed:10000 Mtu:8901} {Name:683ccdf12b057a8 MacAddress:de:ad:0e:85:a2:57 Speed:10000 Mtu:8901} {Name:714855a2a6f1b4f MacAddress:36:b6:2f:35:cb:ea Speed:10000 Mtu:8901} {Name:74a76aa5dd04221 MacAddress:ae:39:ef:1d:b3:26 Speed:10000 Mtu:8901} {Name:8733fa9ee5839c4 MacAddress:9e:34:3e:10:28:fb Speed:10000 Mtu:8901} {Name:8d191e269f6e881 MacAddress:52:e4:20:07:13:2d Speed:10000 Mtu:8901} {Name:991c5e396e92d06 MacAddress:8e:37:d3:f6:ba:ab Speed:10000 Mtu:8901} {Name:a1d1a5bbea5ad4e MacAddress:9a:a3:57:d8:0f:e3 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:cb:79:75:61 Speed:0 Mtu:9001} {Name:br-int MacAddress:f6:d1:47:af:48:12 Speed:0 Mtu:8901} {Name:cfaf22a19c2da2d MacAddress:fa:40:de:48:2b:83 Speed:10000 Mtu:8901} {Name:d0a2441cf21ab3a MacAddress:ca:2e:53:25:12:2c Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:cb:79:75:61 Speed:0 Mtu:9001} {Name:fdfaa30f4a7998a MacAddress:f2:0d:a8:48:59:d9 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:0a:bb:64:0b:b2:e6 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:52:a3:97:d5:38:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:58.303076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303007    5115 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:58.303076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303054    5115 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:58.303375 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303354    5115 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:58.303511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303374    5115 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-104.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:58.303584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303513    5115 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:58.303584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303543    5115 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:58.303584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303556    5115 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:58.303584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303568    5115 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:58.303683 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303588    5115 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:58.303768 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303758    5115 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:58.303874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303866    5115 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:58.303935 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303926    5115 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:58.303973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303942    5115 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:58.303973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303954    5115 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:58.303973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303962    5115 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:58.303973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.303970    5115 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:58.312863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.312841    5115 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:58.312863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.312860    5115 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:58.313443 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.313422    5115 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:58.315756 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.315741    5115 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:58.315756 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.315755    5115 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:58.315862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.315853    5115 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:38:58.316047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316036    5115 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:58.316079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316066    5115 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:58.316166 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316158    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:58.316197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316171    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:58.316197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316178    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:58.316197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316184    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:58.316197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316190    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:58.316197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316195    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316201    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316207    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316214    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316220    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316271    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316280    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316315    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:58.316341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316321    5115 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:58.316880 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.316860    5115 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:58.318645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.318627    5115 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:58.320766 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.320752    5115 server.go:1263] "Started kubelet"
Oct 30 20:38:58.321377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.320839    5115 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:58.321377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.320936    5115 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:58.321377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.320861    5115 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:58.321377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.321317    5115 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:58.321296 ip-10-0-135-104 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:58.322493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.322474    5115 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:58.328222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328165    5115 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:58.328222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328188    5115 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:58.328372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328341    5115 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:18 +0000 UTC" deadline="2028-07-19 09:47:48.037215094 +0000 UTC"
Oct 30 20:38:58.328372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328362    5115 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15061h8m49.708855812s"
Oct 30 20:38:58.328464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328394    5115 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:58.328464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328401    5115 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:58.328590 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.328518    5115 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:58.331829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331547    5115 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:58.331829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331608    5115 factory.go:55] Registering systemd factory
Oct 30 20:38:58.331829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331639    5115 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331830    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed48d0ae-a851-40ae-89cc-03cd70d91da4" volumeName="kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331868    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09460045-d0af-4ea6-8c50-e3516d295859" volumeName="kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331881    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b62c70f-47d9-4521-8e32-e5c65c0c7e87" volumeName="kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331894    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331905    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331917    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69b633d2-97d9-4a07-9506-45658f48ee49" volumeName="kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331928    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9da979e4-86df-4578-8761-5fdf0ba9da9c" volumeName="kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331940    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a99477a2-e4e4-4608-a66e-00009ec9f50d" volumeName="kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331954    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" volumeName="kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331963    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e031a4-99dd-4bbc-b69f-1e5c85e3ac77" volumeName="kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331972    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23ea3055-97ae-427c-a023-3169446b3bae" volumeName="kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path" seLinuxMountContext=""
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331977    5115 factory.go:153] Registering CRI-O factory
Oct 30 20:38:58.332025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331990    5115 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.331980    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332050    5115 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332058    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ea22bf5-fa1a-46e5-9a03-002f5086b4fa" volumeName="kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332069    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5481d1d9-8de8-42b6-bb7b-f9815b9e3f50" volumeName="kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332074    5115 factory.go:103] Registering Raw factory
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332083    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a99477a2-e4e4-4608-a66e-00009ec9f50d" volumeName="kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332089    5115 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332092    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0892a92-0735-4167-b582-537e22ec72c4" volumeName="kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332100    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce4b1301-6a55-465f-af3b-6e1113a45271" volumeName="kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332107    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332140    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e3625a5-852d-480b-a6e8-91ab6b2778b3" volumeName="kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332156    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332172    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332183    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ea22bf5-fa1a-46e5-9a03-002f5086b4fa" volumeName="kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332191    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" volumeName="kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332198    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="372fd9ae-8977-4e6b-999b-f95ef59b0a44" volumeName="kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332206    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c8823a4-a700-41c4-bb61-bc5144e9d1eb" volumeName="kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332213    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9da979e4-86df-4578-8761-5fdf0ba9da9c" volumeName="kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332220    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d40186c5-2e27-4466-9673-61b5de376741" volumeName="kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332233    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22d96d38-8111-4e17-9bcf-14205835c57c" volumeName="kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332243    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23ea3055-97ae-427c-a023-3169446b3bae" volumeName="kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332250    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="372fd9ae-8977-4e6b-999b-f95ef59b0a44" volumeName="kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332258    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="590ec5f5-833c-45d4-aec7-1d3409d62913" volumeName="kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332265    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0892a92-0735-4167-b582-537e22ec72c4" volumeName="kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332272    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce4b1301-6a55-465f-af3b-6e1113a45271" volumeName="kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332281    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69b633d2-97d9-4a07-9506-45658f48ee49" volumeName="kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332288    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79fa788b-5742-40c8-9fa5-7e2cc2cd2005" volumeName="kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332296    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79fa788b-5742-40c8-9fa5-7e2cc2cd2005" volumeName="kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332303    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332310    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332318    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed48d0ae-a851-40ae-89cc-03cd70d91da4" volumeName="kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332326    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12625149-ab99-482a-8617-4ef8fe1b541a" volumeName="kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332334    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332341    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332349    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b62c70f-47d9-4521-8e32-e5c65c0c7e87" volumeName="kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332356    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b62c70f-47d9-4521-8e32-e5c65c0c7e87" volumeName="kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332365    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23ea3055-97ae-427c-a023-3169446b3bae" volumeName="kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332374    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="44d448e2-3ecb-4f8e-a8a9-9220518c481c" volumeName="kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332382    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50d8f3d8-875f-413d-996a-a4a68910b7fd" volumeName="kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332389    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="514248b1-0652-4a5a-bc20-74442c71b232" volumeName="kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332397    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ff4a44-54fe-4984-a650-5d182ee89e4c" volumeName="kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332405    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332413    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332421    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332429    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332445    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332453    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="539bc22b-62ae-4c20-8d54-8f57f0603995" volumeName="kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332460    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69b633d2-97d9-4a07-9506-45658f48ee49" volumeName="kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332484    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="431fae52-1d80-468d-bdc3-cab61bc318ad" volumeName="kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332492    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79fa788b-5742-40c8-9fa5-7e2cc2cd2005" volumeName="kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332500    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332507    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8a35cdb-dc87-4e5e-8183-e42a6db8995f" volumeName="kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332515    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce4b1301-6a55-465f-af3b-6e1113a45271" volumeName="kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332543    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed48d0ae-a851-40ae-89cc-03cd70d91da4" volumeName="kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332552    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12625149-ab99-482a-8617-4ef8fe1b541a" volumeName="kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332560    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="372fd9ae-8977-4e6b-999b-f95ef59b0a44" volumeName="kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332568    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e3625a5-852d-480b-a6e8-91ab6b2778b3" volumeName="kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332576    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="514248b1-0652-4a5a-bc20-74442c71b232" volumeName="kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332583    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="539bc22b-62ae-4c20-8d54-8f57f0603995" volumeName="kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332591    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="590ec5f5-833c-45d4-aec7-1d3409d62913" volumeName="kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332601    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332613    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="876aecfc-cf95-4ebc-8161-c89868e64e8d" volumeName="kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332625    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e031a4-99dd-4bbc-b69f-1e5c85e3ac77" volumeName="kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332635    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23ea3055-97ae-427c-a023-3169446b3bae" volumeName="kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332647    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8a35cdb-dc87-4e5e-8183-e42a6db8995f" volumeName="kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332658    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" volumeName="kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332671    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99" volumeName="kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332684    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332696    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ef66a03-585f-43d9-b678-7c5e84ad17f8" volumeName="kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332709    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ef0d2d8-9e6e-485e-8db3-59668d3fefb7" volumeName="kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls" seLinuxMountContext=""
Oct 30 20:38:58.332664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332722    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78825b89-4bdd-4e7c-b145-e3f5b3eab767" volumeName="kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332735    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b62c70f-47d9-4521-8e32-e5c65c0c7e87" volumeName="kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332746    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8a35cdb-dc87-4e5e-8183-e42a6db8995f" volumeName="kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332757    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" volumeName="kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332768    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" volumeName="kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332780    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e3625a5-852d-480b-a6e8-91ab6b2778b3" volumeName="kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332790    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="590ec5f5-833c-45d4-aec7-1d3409d62913" volumeName="kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332802    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69b633d2-97d9-4a07-9506-45658f48ee49" volumeName="kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332813    5115 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b62c70f-47d9-4521-8e32-e5c65c0c7e87" volumeName="kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332824    5115 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332831    5115 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:58.335951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.332422    5115 manager.go:319] Starting recovery of all containers
Oct 30 20:38:58.339032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.338096    5115 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:38:58.346978 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.346956    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:38:58.347579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.347516    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:38:58.358745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.358702    5115 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:58.360052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.360021    5115 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:58.360052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.360053    5115 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:58.360220 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.360073    5115 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:58.360220 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.360113    5115 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:38:58.362935 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.362819    5115 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:58.384111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.384085    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:38:58.384329 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.384114    5115 generic.go:356] "Generic (PLEG): container finished" podID="69b633d2-97d9-4a07-9506-45658f48ee49" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391" exitCode=255
Oct 30 20:38:58.387860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387835    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="a34ee09047c6bcec6aabacc6c73dbb35975592891192515f3815efcec62fafa6" exitCode=0
Oct 30 20:38:58.387860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387858    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="4b5a3e7db8c79c258716cc2eb948298f6d3e20004b66ce6bb2610e526da429b3" exitCode=0
Oct 30 20:38:58.387860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387865    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="7c085e60602e0c12b111e4c6f320f1216062f4ff1ea2a40f89059371fe8cf2da" exitCode=0
Oct 30 20:38:58.388092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387872    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="9132f1243f6af2f0ca8f4d41f3050db936cf8245b2444457d1eabe9e8f525e5e" exitCode=0
Oct 30 20:38:58.388092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387879    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="79f33fa66c1d9867b7062e0202878b7a867f6eff6fedca02b9ec7a43d17708b1" exitCode=0
Oct 30 20:38:58.388092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.387885    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4a6b910-20b3-4568-8d1e-b9d0c80b57c5" containerID="ef07145b3b1a3e2b847289e1e47b3a62c61e38291e704642ab41ba4d59d84cf6" exitCode=0
Oct 30 20:38:58.392195 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.392170    5115 generic.go:356] "Generic (PLEG): container finished" podID="3df339c34627d7b2ef5d4c725a2c41ea" containerID="20e454c27428ca3a4f6dcdeb088df6fe710eb6e22f5107a356255dec94922f1f" exitCode=0
Oct 30 20:38:58.434629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.434605    5115 manager.go:324] Recovery completed
Oct 30 20:38:58.454942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.454916    5115 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:58.454942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.454932    5115 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:58.454942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.454950    5115 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455065    5115 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455076    5115 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455092    5115 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455097    5115 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455102    5115 policy_none.go:50] "Start"
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455110    5115 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:58.455163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455118    5115 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:58.455360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455252    5115 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:38:58.455360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455258    5115 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:38:58.455360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.455264    5115 policy_none.go:44] "Start"
Oct 30 20:38:58.461154 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.461127    5115 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 20:38:58.461285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.461261    5115 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:58.463891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.463867    5115 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:58.463992 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.463900    5115 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:58.463992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.463912    5115 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:58.464673 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464655    5115 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:58.464758 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464672    5115 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:58.464812 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464778    5115 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:58.464933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464890    5115 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:58.464992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464935    5115 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:58.464992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464941    5115 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:58.465083 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.464971    5115 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:58.464923828Z","UUID":"5afa7251-0227-4bb1-b6b9-de499a19e9d1","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:58.466167 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.466143    5115 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:58.466422 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.466404    5115 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:58.466495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.466433    5115 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:58.564918 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.564882    5115 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:58.567369 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.567352    5115 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:58.567437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.567384    5115 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:58.567437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.567396    5115 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-104.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:58.567517 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.567438    5115 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.578060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.578038    5115 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.578207 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.578112    5115 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.661500 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.661375    5115 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"]
Oct 30 20:38:58.662223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662197    5115 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.662359 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662243    5115 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.662359 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662216    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerStarted","Data":"382d9dd01173e3ff71974599d1be03cf9b4b997c4a1b0ca14fd75d29e6560f1d"}
Oct 30 20:38:58.662477 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662378    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerDied","Data":"20e454c27428ca3a4f6dcdeb088df6fe710eb6e22f5107a356255dec94922f1f"}
Oct 30 20:38:58.662477 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662440    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"3df339c34627d7b2ef5d4c725a2c41ea","Type":"ContainerStarted","Data":"5cd5fbedae26f801ccaf8d5276cb2499a1d409ddb611f54757aa96bc97114e4e"}
Oct 30 20:38:58.662594 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662543    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"dab6cd5a3212618f353a61406cc55b55","Type":"ContainerStarted","Data":"8d0cdbc95b3abc7e6b2362f4ac62f9a8628e3b9f12d44e81d3130f5cba95b548"}
Oct 30 20:38:58.662594 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.662571    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal" event={"ID":"dab6cd5a3212618f353a61406cc55b55","Type":"ContainerStarted","Data":"bcea213dfd8b5a211fb031b58f6b69234ba899ca57cbe9ab834141119d76a081"}
Oct 30 20:38:58.676693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.676672    5115 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:58.676792 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.676723    5115 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.677248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.677230    5115 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:58.677332 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:58.677276    5115 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.739754 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.739706    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.739754 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.739757    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.739962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.739818    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840345    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840395    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840423    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840478    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840540    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3df339c34627d7b2ef5d4c725a2c41ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"3df339c34627d7b2ef5d4c725a2c41ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:58.840625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:58.840481    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dab6cd5a3212618f353a61406cc55b55-config\") pod \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" (UID: \"dab6cd5a3212618f353a61406cc55b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:59.304568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.304515    5115 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:59.318304 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.318276    5115 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:59.319010 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.318985    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2","openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk","openshift-network-console/networking-console-plugin-86c478bb88-2psb7","openshift-ovn-kubernetes/ovnkube-node-8nd5w","openshift-dns/node-resolver-mx29f","openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc","openshift-multus/multus-qfbjr","openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz","openshift-service-ca/service-ca-5fffc97bdf-gw6lr","openshift-insights/insights-operator-7c4986d449-p8qgf","openshift-image-registry/image-registry-c697d468-vwwrx","openshift-cluster-node-tuning-operator/tuned-mzrsz","openshift-ingress/router-default-6987c8f769-xrp2s","kube-system/kas-connection-checker-685895c7c9-ghwzz","kube-system/global-pull-secret-syncer-8qztc","openshift-network-diagnostics/network-check-target-85qnr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal","kube-system/konnectivity-agent-k6rvl","openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9","openshift-console-operator/console-operator-7cd56b8dbc-g8jj6","openshift-multus/network-metrics-daemon-knt4f","openshift-image-registry/node-ca-7wb5s","openshift-insights/periodic-gathering-t8d6k-rmv2f","kube-system/kas-connection-checker-685895c7c9-2hkcr","openshift-multus/multus-additional-cni-plugins-nzzx9","openshift-insights/insights-runtime-extractor-9xhnp","kube-system/kas-connection-checker-685895c7c9-v92r5","openshift-image-registry/image-registry-5574bcc85f-zcrr4","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7","openshift-dns/dns-default-8llmk","openshift-monitoring/cluster-monitoring-operator-884576c57-wx776","kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal","openshift-ingress-canary/ingress-canary-zmw72","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj","openshift-network-operator/iptables-alerter-77clk"]
Oct 30 20:38:59.320252 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.320230    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.321506 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.321483    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.322748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.322726    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.322960 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.322939    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.323085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.323073    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.323457 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.323434    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.327168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.327148    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:38:59.330636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.330610    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.330813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.330799    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:38:59.330978 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.330960    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xcggs\""
Oct 30 20:38:59.331043 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331028    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:38:59.331098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331066    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:38:59.331144 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331121    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:38:59.331686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331669    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:38:59.331750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331727    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.331921 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331908    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ndr57\""
Oct 30 20:38:59.331970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.331947    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d6mm6\""
Oct 30 20:38:59.332067 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.332054    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:38:59.332192 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.332180    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xhgsl\""
Oct 30 20:38:59.332326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.332310    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-f59gk\""
Oct 30 20:38:59.332386 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.332372    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:38:59.332946 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.332923    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:38:59.333361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.333345    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9vx2g\""
Oct 30 20:38:59.333418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.333411    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.334355 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334330    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:59.334487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334343    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vr4kn\""
Oct 30 20:38:59.334487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334425    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.334487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334438    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:38:59.334487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334454    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4khcx\""
Oct 30 20:38:59.334487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334475    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334516    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334600    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334622    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334601    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334669    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g4v6z\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334635    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334702    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334704    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334716    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334739    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.334782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334765    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vhjmh\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334789    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334801    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334801    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334886    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334891    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kjrht\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334930    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334979    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.334989    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335031    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335129    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-d5kr7\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335158    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335183    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335213    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335246    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hh9qp\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335260    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.335335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335282    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335497    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4gdbd\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335596    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335670    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335856    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335904    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.335961    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336073    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336136    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-5cndb\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336200    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336255    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336326    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.336406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336374    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.337090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336543    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.337090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336744    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:59.337090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.336883    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:59.337233 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.337129    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b74p\""
Oct 30 20:38:59.337233 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.337206    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.337938 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.337920    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.338017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.337985    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:38:59.338235 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.338221    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.338600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.338580    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.338710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.338694    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7chw8\""
Oct 30 20:38:59.339346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339330    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:59.339346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339340    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.339680 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339582    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.339749 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339595    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.339749 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339647    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b7wk5\""
Oct 30 20:38:59.339749 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339618    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:59.339927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339856    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p7gr\""
Oct 30 20:38:59.340002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339988    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:59.340002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.339995    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.340598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.340578    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.340981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.340963    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.341058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.340979    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.341058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.341000    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:59.341058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.341025    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w89q8\""
Oct 30 20:38:59.341560 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.341498    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:59.341645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.341581    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:59.341645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.341616    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kszdw\""
Oct 30 20:38:59.342748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342719    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.342748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342734    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.342860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342769    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdc6n\" (UniqueName: \"kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.342860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342799    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.342860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342729    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:59.342860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342834    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.343076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342864    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.343076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.342912    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:38:59.343076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343013    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:38:59.343208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343093    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.343208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343170    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ndwvd\""
Oct 30 20:38:59.343312 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343135    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2k8l\" (UniqueName: \"kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l\") pod \"kas-connection-checker-685895c7c9-v92r5\" (UID: \"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99\") " pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:59.343312 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343289    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.343534 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343502    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:38:59.343593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343549    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:38:59.343759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343740    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bv2n9\""
Oct 30 20:38:59.343879 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.343858    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:38:59.344067 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344046    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsq29\" (UniqueName: \"kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.344124 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344088    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.344175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344119    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr777\" (UniqueName: \"kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.344345 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344325    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-service-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.344397 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344377    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.344447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344403    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.344504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344453    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-tmp\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.344504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344466    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmkbv\" (UniqueName: \"kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.344615 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344511    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5wkh\" (UniqueName: \"kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.344759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344693    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.344892 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344869    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.344980 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344957    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pl5jd\""
Oct 30 20:38:59.345025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.344996    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.345154 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345124    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.345202 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345176    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.345843 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345814    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7cz\" (UniqueName: \"kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz\") pod \"volume-data-source-validator-58c9f5f46d-hq7l2\" (UID: \"44d448e2-3ecb-4f8e-a8a9-9220518c481c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:59.345923 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345870    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.345976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345925    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.345976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345959    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:59.346069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345969    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cr4sq\""
Oct 30 20:38:59.346069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.345996    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgpn\" (UniqueName: \"kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn\") pod \"network-check-source-6f78d59f99-nffwz\" (UID: \"d40186c5-2e27-4466-9673-61b5de376741\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:59.346069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346031    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.346221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346082    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8t6t\" (UniqueName: \"kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t\") pod \"kas-connection-checker-685895c7c9-ghwzz\" (UID: \"22d96d38-8111-4e17-9bcf-14205835c57c\") " pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:59.346221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346118    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.346221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346153    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.346221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346185    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.346221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346217    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.346453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346247    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.346453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346277    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.346453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346347    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.346453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346385    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.346453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346426    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8brj\" (UniqueName: \"kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346458    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346497    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346546    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346586    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346622    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwbw4\" (UniqueName: \"kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.346691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346653    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovn-node-metrics-cert\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.346953 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346714    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57q8t\" (UniqueName: \"kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.346953 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.346747    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.347284 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.347250    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:38:59.347731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.347696    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-trusted-ca\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.347874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.347849    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876aecfc-cf95-4ebc-8161-c89868e64e8d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.348061 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348043    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.348218 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348176    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvvz\" (UniqueName: \"kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.348395 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348374    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.348608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348558    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.348819 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348800    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.348992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348967    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.349217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349165    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.349318 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349251    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.349411 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349351    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdqx\" (UniqueName: \"kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.349475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349458    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.349571 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349552    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2twjb\""
Oct 30 20:38:59.349622 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349564    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:59.349669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349609    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.349715 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349663    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.349792 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349776    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.349946 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349927    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.350031 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.349975    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.350075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.350052    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.350121 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.350090    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.350172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.350146    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.350232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.350219    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:38:59.350835 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.348617    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:38:59.351092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351072    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkhg\" (UniqueName: \"kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.351151 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351114    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.351198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351177    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.351371 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351352    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.351429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351399    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.351474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351439    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.351474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351460    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/539bc22b-62ae-4c20-8d54-8f57f0603995-iptables-alerter-script\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.351609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351478    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.351609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351519    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.351609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351581    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.351739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351613    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e3625a5-852d-480b-a6e8-91ab6b2778b3-config\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.351739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351619    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a99477a2-e4e4-4608-a66e-00009ec9f50d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.351739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351658    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.351739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351695    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5846\" (UniqueName: \"kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.351908 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351745    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.351908 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351788    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.351908 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351833    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.351908 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351866    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.352086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351904    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.352086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351943    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.352086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351959    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-script-lib\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.352086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.351982    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjk8j\" (UniqueName: \"kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j\") pod \"kas-connection-checker-685895c7c9-2hkcr\" (UID: \"78825b89-4bdd-4e7c-b145-e3f5b3eab767\") " pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:59.352259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.352111    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12625149-ab99-482a-8617-4ef8fe1b541a-agent-certs\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:59.352259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.352226    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12625149-ab99-482a-8617-4ef8fe1b541a-konnectivity-ca\") pod \"konnectivity-agent-k6rvl\" (UID: \"12625149-ab99-482a-8617-4ef8fe1b541a\") " pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:38:59.352259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.352231    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-default-certificate\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.352509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.352486    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.353057 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.353010    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.353325 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.353277    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef66a03-585f-43d9-b678-7c5e84ad17f8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.353697 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.353658    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3625a5-852d-480b-a6e8-91ab6b2778b3-serving-cert\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.354063 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.354033    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69b633d2-97d9-4a07-9506-45658f48ee49-config\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.354491 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.354465    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdc6n\" (UniqueName: \"kubernetes.io/projected/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-kube-api-access-bdc6n\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.354604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.354582    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsq29\" (UniqueName: \"kubernetes.io/projected/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-kube-api-access-nsq29\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355576    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-ovnkube-config\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355785    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-snapshots\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355846    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355875    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-env-overrides\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355903    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.355966    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0892a92-0735-4167-b582-537e22ec72c4-tmp-dir\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356019    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356067    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876aecfc-cf95-4ebc-8161-c89868e64e8d-tmp\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356139    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-tuned\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356140    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69b633d2-97d9-4a07-9506-45658f48ee49-serving-cert\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356242    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356365    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.356492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356450    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-stats-auth\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.356922 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356543    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.356922 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356550    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.356922 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356614    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.356922 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.356910    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876aecfc-cf95-4ebc-8161-c89868e64e8d-serving-cert\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.357196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.357139    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.357914 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.357895    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8a35cdb-dc87-4e5e-8183-e42a6db8995f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dcct7\" (UID: \"c8a35cdb-dc87-4e5e-8183-e42a6db8995f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7"
Oct 30 20:38:59.358435 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.358422    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 20:38:59.358539 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.358425    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 20:38:59.359241 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.359224    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 20:38:59.359600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.359584    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5wkh\" (UniqueName: \"kubernetes.io/projected/3e3625a5-852d-480b-a6e8-91ab6b2778b3-kube-api-access-c5wkh\") pod \"service-ca-operator-544d749c8c-z97zc\" (UID: \"3e3625a5-852d-480b-a6e8-91ab6b2778b3\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc"
Oct 30 20:38:59.359698 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.359683    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr777\" (UniqueName: \"kubernetes.io/projected/ce4b1301-6a55-465f-af3b-6e1113a45271-kube-api-access-kr777\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.360791 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.360762    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2k8l\" (UniqueName: \"kubernetes.io/projected/05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99-kube-api-access-f2k8l\") pod \"kas-connection-checker-685895c7c9-v92r5\" (UID: \"05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99\") " pod="kube-system/kas-connection-checker-685895c7c9-v92r5"
Oct 30 20:38:59.360898 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.360843    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57q8t\" (UniqueName: \"kubernetes.io/projected/a99477a2-e4e4-4608-a66e-00009ec9f50d-kube-api-access-57q8t\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.361052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.361035    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmkbv\" (UniqueName: \"kubernetes.io/projected/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kube-api-access-mmkbv\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.361407 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.361368    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7cz\" (UniqueName: \"kubernetes.io/projected/44d448e2-3ecb-4f8e-a8a9-9220518c481c-kube-api-access-wd7cz\") pod \"volume-data-source-validator-58c9f5f46d-hq7l2\" (UID: \"44d448e2-3ecb-4f8e-a8a9-9220518c481c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hq7l2"
Oct 30 20:38:59.361674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.361658    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vdqx\" (UniqueName: \"kubernetes.io/projected/b0892a92-0735-4167-b582-537e22ec72c4-kube-api-access-4vdqx\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.362122 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.362103    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjvt\" (UniqueName: \"kubernetes.io/projected/9c8823a4-a700-41c4-bb61-bc5144e9d1eb-kube-api-access-zjjvt\") pod \"network-check-target-85qnr\" (UID: \"9c8823a4-a700-41c4-bb61-bc5144e9d1eb\") " pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:38:59.363015 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.362993    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5846\" (UniqueName: \"kubernetes.io/projected/69b633d2-97d9-4a07-9506-45658f48ee49-kube-api-access-m5846\") pod \"console-operator-7cd56b8dbc-g8jj6\" (UID: \"69b633d2-97d9-4a07-9506-45658f48ee49\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:38:59.368360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.368335    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8t6t\" (UniqueName: \"kubernetes.io/projected/22d96d38-8111-4e17-9bcf-14205835c57c-kube-api-access-g8t6t\") pod \"kas-connection-checker-685895c7c9-ghwzz\" (UID: \"22d96d38-8111-4e17-9bcf-14205835c57c\") " pod="kube-system/kas-connection-checker-685895c7c9-ghwzz"
Oct 30 20:38:59.368445 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.368390    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgpn\" (UniqueName: \"kubernetes.io/projected/d40186c5-2e27-4466-9673-61b5de376741-kube-api-access-rzgpn\") pod \"network-check-source-6f78d59f99-nffwz\" (UID: \"d40186c5-2e27-4466-9673-61b5de376741\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-nffwz"
Oct 30 20:38:59.368558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.368537    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvvz\" (UniqueName: \"kubernetes.io/projected/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-kube-api-access-mbvvz\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.368713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.368694    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8brj\" (UniqueName: \"kubernetes.io/projected/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-kube-api-access-d8brj\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.368750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.368724    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwbw4\" (UniqueName: \"kubernetes.io/projected/876aecfc-cf95-4ebc-8161-c89868e64e8d-kube-api-access-wwbw4\") pod \"insights-operator-7c4986d449-p8qgf\" (UID: \"876aecfc-cf95-4ebc-8161-c89868e64e8d\") " pod="openshift-insights/insights-operator-7c4986d449-p8qgf"
Oct 30 20:38:59.373432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.373407    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjk8j\" (UniqueName: \"kubernetes.io/projected/78825b89-4bdd-4e7c-b145-e3f5b3eab767-kube-api-access-wjk8j\") pod \"kas-connection-checker-685895c7c9-2hkcr\" (UID: \"78825b89-4bdd-4e7c-b145-e3f5b3eab767\") " pod="kube-system/kas-connection-checker-685895c7c9-2hkcr"
Oct 30 20:38:59.373492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.373438    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkhg\" (UniqueName: \"kubernetes.io/projected/539bc22b-62ae-4c20-8d54-8f57f0603995-kube-api-access-8vkhg\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.425101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.425077    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 20:38:59.425288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.425157    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zrd5p\""
Oct 30 20:38:59.425360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.425294    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rx7vx\""
Oct 30 20:38:59.427944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.427924    5115 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:59.428059 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.428035    5115 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:59.430059 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.430040    5115 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:59.438973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.438954    5115 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:59.439061 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.438994    5115 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:59.439287 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.439271    5115 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:59.439351 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.439307    5115 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-104.us-east-2.compute.internal"
Oct 30 20:38:59.457499 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457475    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.457644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457503    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.457644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457551    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.457644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457588    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.457644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457608    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25v9\" (UniqueName: \"kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.457644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457632    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457658    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457673    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed48d0ae-a851-40ae-89cc-03cd70d91da4-tmp-dir\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457684    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457693    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457720    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lhxf\" (UniqueName: \"kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457746    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457768    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457793    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457816    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457841    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457878    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk8q2\" (UniqueName: \"kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.457949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457910    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrq9\" (UniqueName: \"kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.457965    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458000    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458026    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458041    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458043    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-lib-modules\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458095    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0892a92-0735-4167-b582-537e22ec72c4-hosts-file\") pod \"node-resolver-mx29f\" (UID: \"b0892a92-0735-4167-b582-537e22ec72c4\") " pod="openshift-dns/node-resolver-mx29f"
Oct 30 20:38:59.458334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458200    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-modprobe-d\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458353    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458373    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-cabundle\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458391    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458420    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458446    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458450    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458392    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458471    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458511    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458550    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458577    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458583    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.458608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458607    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458618    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458649    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2smsw\" (UniqueName: \"kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw\") pod \"migrator-66df5d496b-z4gcv\" (UID: \"09ff4a44-54fe-4984-a650-5d182ee89e4c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458686    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhlls\" (UniqueName: \"kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458689    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-registration-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458794    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458815    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458871    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fp5n\" (UniqueName: \"kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458904    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458921    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458958    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458974    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.458996    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459012    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459029    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459046    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459113    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4srqc\" (UniqueName: \"kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459139    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459170    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.459201    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:59.959179586 +0000 UTC m=+1.763074337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:59.459261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459234    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459273    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459300    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459343    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459415    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459445    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459473    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459507    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459548    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459580    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459604    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459627    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459650    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459727    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/514248b1-0652-4a5a-bc20-74442c71b232-serviceca\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459841    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459867    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-cert\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459870    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459896    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459912    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-bin\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459926    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459947    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-etc-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459955    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.459982    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460010    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rljt\" (UniqueName: \"kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460037    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460062    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460089    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460114    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460147    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460175    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-var-lib-kubelet\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.460259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460236    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460465    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d8f3d8-875f-413d-996a-a4a68910b7fd-original-pull-secret\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.460594    5115 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460615    5115 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.460658    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:59.960642528 +0000 UTC m=+1.764537284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460725    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-etc-selinux\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.460916    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-cni-netd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461187    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.461710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461595    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461730    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed48d0ae-a851-40ae-89cc-03cd70d91da4-config-volume\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461756    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-systemd-units\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461911    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461934    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461974    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.461990    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462008    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462036    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462055    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462074    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462090    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.462108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462106    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.462721 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462145    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-sys-fs\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.462721 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462407    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da979e4-86df-4578-8761-5fdf0ba9da9c-data-volume\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.462721 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462623    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-sys\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.462721 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462671    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-host\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.462721 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.462716    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-device-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.463102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463028    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99477a2-e4e4-4608-a66e-00009ec9f50d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-wx776\" (UID: \"a99477a2-e4e4-4608-a66e-00009ec9f50d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.463102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463057    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.463240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463124    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-systemd\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.463240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463185    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.463240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463222    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.463379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463256    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.463379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463290    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.463379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463322    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.463379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463331    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-cni-binary-copy\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.463584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463398    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.463584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463422    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.463584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463467    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-var-lib-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.463733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463673    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463834    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-slash\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463899    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-daemon-config\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.463961    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464029    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-ovn\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464097    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464103    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/539bc22b-62ae-4c20-8d54-8f57f0603995-host-slash\") pod \"iptables-alerter-77clk\" (UID: \"539bc22b-62ae-4c20-8d54-8f57f0603995\") " pod="openshift-network-operator/iptables-alerter-77clk"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464199    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5481d1d9-8de8-42b6-bb7b-f9815b9e3f50-socket-dir\") pod \"aws-ebs-csi-driver-node-fx2dj\" (UID: \"5481d1d9-8de8-42b6-bb7b-f9815b9e3f50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fx2dj"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464256    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464342    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464389    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464431    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464509    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464557    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-systemd\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464608    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-node-log\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464651    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464677    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464790    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464895    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/372fd9ae-8977-4e6b-999b-f95ef59b0a44-signing-key\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464902    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464894    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464941    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.464969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.464964    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-run\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465015    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465053    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s2rd\" (UniqueName: \"kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd\") pod \"migrator-66df5d496b-fb5nk\" (UID: \"09460045-d0af-4ea6-8c50-e3516d295859\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465079    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465114    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465184    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465304    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465323    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465335    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465397    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-run-openvswitch\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465406    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysconfig\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465432    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465462    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465474    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-run-netns\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465497    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef66a03-585f-43d9-b678-7c5e84ad17f8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-2psb7\" (UID: \"4ef66a03-585f-43d9-b678-7c5e84ad17f8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465502    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465544    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-log-socket\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465552    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465610    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-kubernetes\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465711    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465752    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465789    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465819    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465838    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465924    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce4b1301-6a55-465f-af3b-6e1113a45271-etc-sysctl-conf\") pod \"tuned-mzrsz\" (UID: \"ce4b1301-6a55-465f-af3b-6e1113a45271\") " pod="openshift-cluster-node-tuning-operator/tuned-mzrsz"
Oct 30 20:38:59.466130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.465945    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b62c70f-47d9-4521-8e32-e5c65c0c7e87-host-kubelet\") pod \"ovnkube-node-8nd5w\" (UID: \"7b62c70f-47d9-4521-8e32-e5c65c0c7e87\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:38:59.467302 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.466206    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ea22bf5-fa1a-46e5-9a03-002f5086b4fa-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-gcjn9\" (UID: \"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.467302 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.467222    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.467725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.467690    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25v9\" (UniqueName: \"kubernetes.io/projected/514248b1-0652-4a5a-bc20-74442c71b232-kube-api-access-h25v9\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.468068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.468040    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk8q2\" (UniqueName: \"kubernetes.io/projected/590ec5f5-833c-45d4-aec7-1d3409d62913-kube-api-access-jk8q2\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.468135 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.468076    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.468187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.468171    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrq9\" (UniqueName: \"kubernetes.io/projected/ed48d0ae-a851-40ae-89cc-03cd70d91da4-kube-api-access-gcrq9\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.468237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.468221    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lhxf\" (UniqueName: \"kubernetes.io/projected/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-kube-api-access-9lhxf\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.474701 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.474679    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2smsw\" (UniqueName: \"kubernetes.io/projected/09ff4a44-54fe-4984-a650-5d182ee89e4c-kube-api-access-2smsw\") pod \"migrator-66df5d496b-z4gcv\" (UID: \"09ff4a44-54fe-4984-a650-5d182ee89e4c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z4gcv"
Oct 30 20:38:59.474972 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.474955    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4srqc\" (UniqueName: \"kubernetes.io/projected/07e031a4-99dd-4bbc-b69f-1e5c85e3ac77-kube-api-access-4srqc\") pod \"ingress-canary-zmw72\" (UID: \"07e031a4-99dd-4bbc-b69f-1e5c85e3ac77\") " pod="openshift-ingress-canary/ingress-canary-zmw72"
Oct 30 20:38:59.475695 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.475670    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s2rd\" (UniqueName: \"kubernetes.io/projected/09460045-d0af-4ea6-8c50-e3516d295859-kube-api-access-5s2rd\") pod \"migrator-66df5d496b-fb5nk\" (UID: \"09460045-d0af-4ea6-8c50-e3516d295859\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb5nk"
Oct 30 20:38:59.476428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.476385    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fp5n\" (UniqueName: \"kubernetes.io/projected/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-api-access-8fp5n\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.476535 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.476498    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.476597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.476577    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhlls\" (UniqueName: \"kubernetes.io/projected/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-kube-api-access-nhlls\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.476715 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.476696    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rljt\" (UniqueName: \"kubernetes.io/projected/372fd9ae-8977-4e6b-999b-f95ef59b0a44-kube-api-access-8rljt\") pod \"service-ca-5fffc97bdf-gw6lr\" (UID: \"372fd9ae-8977-4e6b-999b-f95ef59b0a44\") " pod="openshift-service-ca/service-ca-5fffc97bdf-gw6lr"
Oct 30 20:38:59.481808 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.481784    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"image-registry-5574bcc85f-zcrr4\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") " pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:38:59.481808 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.481804    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"periodic-gathering-t8d6k-rmv2f\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") " pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:38:59.566465 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566377    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.566465 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566415    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566465 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566449    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566467    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566505    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da979e4-86df-4578-8761-5fdf0ba9da9c-crio-socket\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566514    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566574    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-socket-dir-parent\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566584    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566625    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566632    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-system-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566672    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566707    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566723    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-cnibin\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.566742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566740    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566764    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-multus\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566767    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566810    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566835    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566859    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566897    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566919    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566932    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-hostroot\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566942    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.566952    5115 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566985    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-kubelet\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566999    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567044    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/514248b1-0652-4a5a-bc20-74442c71b232-host\") pod \"node-ca-7wb5s\" (UID: \"514248b1-0652-4a5a-bc20-74442c71b232\") " pod="openshift-image-registry/node-ca-7wb5s"
Oct 30 20:38:59.567240 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.567132    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:00.067103901 +0000 UTC m=+1.870998658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566894    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-netns\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567404    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da979e4-86df-4578-8761-5fdf0ba9da9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567435    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-dbus\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.566965    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-var-lib-cni-bin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567499    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567501    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-cni-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567548    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567570    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-cnibin\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567616    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567584    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-k8s-cni-cncf-io\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567666    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-multus-conf-dir\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567681    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567699    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-host-run-multus-certs\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567756    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567783    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567784    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-system-cni-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567815    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567850    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d8f3d8-875f-413d-996a-a4a68910b7fd-kubelet-config\") pod \"global-pull-secret-syncer-8qztc\" (UID: \"50d8f3d8-875f-413d-996a-a4a68910b7fd\") " pod="kube-system/global-pull-secret-syncer-8qztc"
Oct 30 20:38:59.567900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.567901    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a6b910-20b3-4568-8d1e-b9d0c80b57c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzzx9\" (UID: \"f4a6b910-20b3-4568-8d1e-b9d0c80b57c5\") " pod="openshift-multus/multus-additional-cni-plugins-nzzx9"
Oct 30 20:38:59.568822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.568056    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/590ec5f5-833c-45d4-aec7-1d3409d62913-etc-kubernetes\") pod \"multus-qfbjr\" (UID: \"590ec5f5-833c-45d4-aec7-1d3409d62913\") " pod="openshift-multus/multus-qfbjr"
Oct 30 20:38:59.576573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.570467    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef0d2d8-9e6e-485e-8db3-59668d3fefb7-metrics-certs\") pod \"network-metrics-daemon-knt4f\" (UID: \"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7\") " pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.576573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.570871    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed48d0ae-a851-40ae-89cc-03cd70d91da4-metrics-tls\") pod \"dns-default-8llmk\" (UID: \"ed48d0ae-a851-40ae-89cc-03cd70d91da4\") " pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.576573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.570991    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"image-registry-c697d468-vwwrx\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") " pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.586837 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.586807    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:38:59.587087 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.587073    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:38:59.621050 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.621023    5115 scope.go:122] "RemoveContainer" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"
Oct 30 20:38:59.621905 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.621880    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"
Oct 30 20:38:59.623358 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.623337    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"
Oct 30 20:38:59.623730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.623710    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7"
Oct 30 20:38:59.637574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.637542    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knt4f"
Oct 30 20:38:59.641636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.641616    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8llmk"
Oct 30 20:38:59.895587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.895511    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:38:59.911952 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:59.911912    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431fae52_1d80_468d_bdc3_cab61bc318ad.slice/crio-205967f16a5c5d0b43bc830adbe6706da0caf7f7ffb3b77fd97436208ee74c2f WatchSource:0}: Error finding container 205967f16a5c5d0b43bc830adbe6706da0caf7f7ffb3b77fd97436208ee74c2f: Status 404 returned error can't find the container with id 205967f16a5c5d0b43bc830adbe6706da0caf7f7ffb3b77fd97436208ee74c2f
Oct 30 20:38:59.949253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.949222    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-wx776"]
Oct 30 20:38:59.952778 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:38:59.952752    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99477a2_e4e4_4608_a66e_00009ec9f50d.slice/crio-f37f9d8b07661073a02159c49d995aa6f26b57469981274e605df88e360e1ab9 WatchSource:0}: Error finding container f37f9d8b07661073a02159c49d995aa6f26b57469981274e605df88e360e1ab9: Status 404 returned error can't find the container with id f37f9d8b07661073a02159c49d995aa6f26b57469981274e605df88e360e1ab9
Oct 30 20:38:59.955111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.955091    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:59.973487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.973453    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.973689 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.973495    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:38:59.973689 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.973635    5115 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:59.973689 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.973638    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:00.973619138 +0000 UTC m=+2.777513890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:59.973689 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:38:59.973685    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:00.973675976 +0000 UTC m=+2.777570713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : secret "router-metrics-certs-default" not found
Oct 30 20:38:59.990836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:38:59.990801    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9"]
Oct 30 20:39:00.018387 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.018362    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8llmk"]
Oct 30 20:39:00.024573 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:00.024516    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded48d0ae_a851_40ae_89cc_03cd70d91da4.slice/crio-b094bd85d62cdbeb65fd3f77e5e6d26ad8c8ab88f8e84f6167084a8cfde328b3 WatchSource:0}: Error finding container b094bd85d62cdbeb65fd3f77e5e6d26ad8c8ab88f8e84f6167084a8cfde328b3: Status 404 returned error can't find the container with id b094bd85d62cdbeb65fd3f77e5e6d26ad8c8ab88f8e84f6167084a8cfde328b3
Oct 30 20:39:00.057910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.057882    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-2psb7"]
Oct 30 20:39:00.061610 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:00.061586    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef66a03_585f_43d9_b678_7c5e84ad17f8.slice/crio-61dbb888c68a53ab6b80a07f08fbb56376f26b082414d5037da9669dce1e9adb WatchSource:0}: Error finding container 61dbb888c68a53ab6b80a07f08fbb56376f26b082414d5037da9669dce1e9adb: Status 404 returned error can't find the container with id 61dbb888c68a53ab6b80a07f08fbb56376f26b082414d5037da9669dce1e9adb
Oct 30 20:39:00.063992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.063936    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knt4f"]
Oct 30 20:39:00.066937 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:00.066912    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef0d2d8_9e6e_485e_8db3_59668d3fefb7.slice/crio-c6a2271a38e54cd53a5f8632ebc6ec8bab4ecbbf2b27fbb1e153d71132cfac4a WatchSource:0}: Error finding container c6a2271a38e54cd53a5f8632ebc6ec8bab4ecbbf2b27fbb1e153d71132cfac4a: Status 404 returned error can't find the container with id c6a2271a38e54cd53a5f8632ebc6ec8bab4ecbbf2b27fbb1e153d71132cfac4a
Oct 30 20:39:00.074561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.074487    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:00.074662 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:00.074640    5115 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:00.074727 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:00.074711    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.074691214 +0000 UTC m=+2.878585963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:00.263158 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.263131    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:39:00.366320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.366238    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5372497c-4ed1-445c-966c-8693956a6b1e" path="/var/lib/kubelet/pods/5372497c-4ed1-445c-966c-8693956a6b1e/volumes"
Oct 30 20:39:00.439047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.439009    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8llmk" event={"ID":"ed48d0ae-a851-40ae-89cc-03cd70d91da4","Type":"ContainerStarted","Data":"b094bd85d62cdbeb65fd3f77e5e6d26ad8c8ab88f8e84f6167084a8cfde328b3"}
Oct 30 20:39:00.441096 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.441027    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/2.log"
Oct 30 20:39:00.441518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.441493    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/1.log"
Oct 30 20:39:00.441662 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.441554    5115 generic.go:356] "Generic (PLEG): container finished" podID="69b633d2-97d9-4a07-9506-45658f48ee49" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078" exitCode=255
Oct 30 20:39:00.441662 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.441634    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerDied","Data":"8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"}
Oct 30 20:39:00.441765 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.441706    5115 scope.go:122] "RemoveContainer" containerID="cda00358f6ebaf4b2e81e4bc09833195c935dbc9ac26a781700c259745fab391"
Oct 30 20:39:00.442088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.442072    5115 scope.go:122] "RemoveContainer" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"
Oct 30 20:39:00.442311 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:00.442281    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:00.444255 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.443728    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7" event={"ID":"4ef66a03-585f-43d9-b678-7c5e84ad17f8","Type":"ContainerStarted","Data":"61dbb888c68a53ab6b80a07f08fbb56376f26b082414d5037da9669dce1e9adb"}
Oct 30 20:39:00.445655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.445622    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c697d468-vwwrx" event={"ID":"431fae52-1d80-468d-bdc3-cab61bc318ad","Type":"ContainerStarted","Data":"5cdf05a9c9a526994b772431adf44207d6ab1d17b6816ec6bf0d891e444bddf6"}
Oct 30 20:39:00.445741 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.445677    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c697d468-vwwrx" event={"ID":"431fae52-1d80-468d-bdc3-cab61bc318ad","Type":"ContainerStarted","Data":"205967f16a5c5d0b43bc830adbe6706da0caf7f7ffb3b77fd97436208ee74c2f"}
Oct 30 20:39:00.447282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.447255    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9" event={"ID":"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa","Type":"ContainerStarted","Data":"f314371f88678f3142063a71fc3fd6dfa4bf2543076e176a72fdb3a7a7461dec"}
Oct 30 20:39:00.448904 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.448877    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776" event={"ID":"a99477a2-e4e4-4608-a66e-00009ec9f50d","Type":"ContainerStarted","Data":"f37f9d8b07661073a02159c49d995aa6f26b57469981274e605df88e360e1ab9"}
Oct 30 20:39:00.450586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.450558    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knt4f" event={"ID":"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7","Type":"ContainerStarted","Data":"c6a2271a38e54cd53a5f8632ebc6ec8bab4ecbbf2b27fbb1e153d71132cfac4a"}
Oct 30 20:39:00.985947 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.984731    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:00.985947 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.984798    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:00.985947 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:00.985514    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle podName:79fa788b-5742-40c8-9fa5-7e2cc2cd2005 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:02.985489995 +0000 UTC m=+4.789384744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle") pod "router-default-6987c8f769-xrp2s" (UID: "79fa788b-5742-40c8-9fa5-7e2cc2cd2005") : configmap references non-existent config key: service-ca.crt
Oct 30 20:39:00.991722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:00.991661    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-metrics-certs\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:01.007484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:01.007407    5115 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:01.085824 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:01.085195    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:01.085824 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:01.085428    5115 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:01.085824 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:01.085491    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:03.085476697 +0000 UTC m=+4.889371445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:01.459629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:01.458581    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/2.log"
Oct 30 20:39:01.459629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:01.458969    5115 scope.go:122] "RemoveContainer" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"
Oct 30 20:39:01.459629 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:01.459174    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:01.544548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:01.544494    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:02.121232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.119881    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:39:02.121232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.120105    5115 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:02.467568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.466784    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-2psb7" event={"ID":"4ef66a03-585f-43d9-b678-7c5e84ad17f8","Type":"ContainerStarted","Data":"a2762f2458a9d83bcbdf0b0d508ddff8123cfe510fba06d1c1b290f5c5b9727a"}
Oct 30 20:39:02.473356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.473295    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9" event={"ID":"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa","Type":"ContainerStarted","Data":"a1b9de31452eeba4ead9b9bddeec1ffafee0f58fc764da81970c66260ebcfb11"}
Oct 30 20:39:02.475546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.475139    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-wx776" event={"ID":"a99477a2-e4e4-4608-a66e-00009ec9f50d","Type":"ContainerStarted","Data":"833871f7d188873e05d115d7ff07b90b0d20d2f03d5e81c4b774593b0fcd649f"}
Oct 30 20:39:02.481423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.481344    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knt4f" event={"ID":"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7","Type":"ContainerStarted","Data":"4171cbe70403720f1392556ca3cab50b3de0a7ad785289463ce4fac74da60f10"}
Oct 30 20:39:02.481423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.481395    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knt4f" event={"ID":"5ef0d2d8-9e6e-485e-8db3-59668d3fefb7","Type":"ContainerStarted","Data":"d3b026681f81838bae03e1231d425bda527e35a86d4465fae8cb9b7082cb993d"}
Oct 30 20:39:02.481746 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:02.481730    5115 scope.go:122] "RemoveContainer" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"
Oct 30 20:39:02.481930 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:02.481910    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:03.003939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.003852    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:03.004454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.004436    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79fa788b-5742-40c8-9fa5-7e2cc2cd2005-service-ca-bundle\") pod \"router-default-6987c8f769-xrp2s\" (UID: \"79fa788b-5742-40c8-9fa5-7e2cc2cd2005\") " pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:03.105138 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.105098    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:03.105293 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:03.105223    5115 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:03.105293 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:03.105276    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls podName:9da979e4-86df-4578-8761-5fdf0ba9da9c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:07.105263276 +0000 UTC m=+8.909158011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9xhnp" (UID: "9da979e4-86df-4578-8761-5fdf0ba9da9c") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:39:03.221017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.220980    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:03.487231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.487195    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-gcjn9" event={"ID":"4ea22bf5-fa1a-46e5-9a03-002f5086b4fa","Type":"ContainerStarted","Data":"54c0b2c0f5be41605450ffbd6e394bdf1ff921ffc99b0f3c100905d8b2d58ada"}
Oct 30 20:39:03.489149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.489125    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8llmk" event={"ID":"ed48d0ae-a851-40ae-89cc-03cd70d91da4","Type":"ContainerStarted","Data":"242f294e94c83b89cba23376a162e3e17c8ef527e26abc18917e2bc05b317496"}
Oct 30 20:39:03.489265 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.489173    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8llmk" event={"ID":"ed48d0ae-a851-40ae-89cc-03cd70d91da4","Type":"ContainerStarted","Data":"6b4739047562e9aee108a89ae2459680af0d1dc56fc1733596d61149775dade6"}
Oct 30 20:39:03.489265 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.489203    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8llmk"
Oct 30 20:39:03.490632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.490606    5115 generic.go:356] "Generic (PLEG): container finished" podID="876aecfc-cf95-4ebc-8161-c89868e64e8d" containerID="c824df0080cea28f41b1d9e4034e4e9d0c4a16592f6b9a4db8b99c2f7d6b25f2" exitCode=0
Oct 30 20:39:03.490734 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.490668    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p8qgf" event={"ID":"876aecfc-cf95-4ebc-8161-c89868e64e8d","Type":"ContainerDied","Data":"c824df0080cea28f41b1d9e4034e4e9d0c4a16592f6b9a4db8b99c2f7d6b25f2"}
Oct 30 20:39:03.490985 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.490969    5115 scope.go:122] "RemoveContainer" containerID="c824df0080cea28f41b1d9e4034e4e9d0c4a16592f6b9a4db8b99c2f7d6b25f2"
Oct 30 20:39:03.492258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.492238    5115 generic.go:356] "Generic (PLEG): container finished" podID="c8a35cdb-dc87-4e5e-8183-e42a6db8995f" containerID="f6c2a0589d23cd5990be5fd0bba6cb66e81c7708d822dc014b5341ede495bd10" exitCode=0
Oct 30 20:39:03.492313 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.492272    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7" event={"ID":"c8a35cdb-dc87-4e5e-8183-e42a6db8995f","Type":"ContainerDied","Data":"f6c2a0589d23cd5990be5fd0bba6cb66e81c7708d822dc014b5341ede495bd10"}
Oct 30 20:39:03.492777 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.492756    5115 scope.go:122] "RemoveContainer" containerID="f6c2a0589d23cd5990be5fd0bba6cb66e81c7708d822dc014b5341ede495bd10"
Oct 30 20:39:03.500880 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:03.500806    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6987c8f769-xrp2s"]
Oct 30 20:39:03.504256 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:03.504233    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fa788b_5742_40c8_9fa5_7e2cc2cd2005.slice/crio-18ba3deb66a2bcc62de6dff0b0bfb4e3617cd2f6da84b743e154c572fb656939 WatchSource:0}: Error finding container 18ba3deb66a2bcc62de6dff0b0bfb4e3617cd2f6da84b743e154c572fb656939: Status 404 returned error can't find the container with id 18ba3deb66a2bcc62de6dff0b0bfb4e3617cd2f6da84b743e154c572fb656939
Oct 30 20:39:04.497793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:04.497760    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p8qgf" event={"ID":"876aecfc-cf95-4ebc-8161-c89868e64e8d","Type":"ContainerStarted","Data":"a1c726fdb8b3fa49dbf2c388389bd54fe38e6ec220c78c4b88aab4499abde5f6"}
Oct 30 20:39:04.499257 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:04.499221    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6987c8f769-xrp2s" event={"ID":"79fa788b-5742-40c8-9fa5-7e2cc2cd2005","Type":"ContainerStarted","Data":"4c326618be3642ff00f69adf84c535716d26db75e09ad201825010a4ef3cb3aa"}
Oct 30 20:39:04.499414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:04.499266    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6987c8f769-xrp2s" event={"ID":"79fa788b-5742-40c8-9fa5-7e2cc2cd2005","Type":"ContainerStarted","Data":"18ba3deb66a2bcc62de6dff0b0bfb4e3617cd2f6da84b743e154c572fb656939"}
Oct 30 20:39:04.501048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:04.501023    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dcct7" event={"ID":"c8a35cdb-dc87-4e5e-8183-e42a6db8995f","Type":"ContainerStarted","Data":"813e598afbf93eb16bf09965cde8490f8cd7f542662c2d1140087bd958fd8d8a"}
Oct 30 20:39:04.657621 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:04.657589    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:05.221993 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.221963    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:05.224572 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.224550    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:05.506473 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.506404    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6987c8f769-xrp2s"
Oct 30 20:39:05.512767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.512738    5115 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6rvl_12625149-ab99-482a-8617-4ef8fe1b541a/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.714877 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.714847    5115 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6rvl_12625149-ab99-482a-8617-4ef8fe1b541a/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.878469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.878442    5115 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6rvl_12625149-ab99-482a-8617-4ef8fe1b541a/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.932695 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:05.932664    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:39:06.003106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:06.003073    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:39:06.023296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:06.023262    5115 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6rvl_12625149-ab99-482a-8617-4ef8fe1b541a/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:07.138465 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.138427    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:07.140718 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.140695    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da979e4-86df-4578-8761-5fdf0ba9da9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xhnp\" (UID: \"9da979e4-86df-4578-8761-5fdf0ba9da9c\") " pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:07.143623 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.143602    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xhnp"
Oct 30 20:39:07.414631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.414551    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xhnp"]
Oct 30 20:39:07.417861 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:07.417830    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da979e4_86df_4578_8761_5fdf0ba9da9c.slice/crio-fb6f6ce8334566803c6d498ef9540732afdcea6b03b776d3f6a0a88a5ca5bbed WatchSource:0}: Error finding container fb6f6ce8334566803c6d498ef9540732afdcea6b03b776d3f6a0a88a5ca5bbed: Status 404 returned error can't find the container with id fb6f6ce8334566803c6d498ef9540732afdcea6b03b776d3f6a0a88a5ca5bbed
Oct 30 20:39:07.518361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.518330    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xhnp" event={"ID":"9da979e4-86df-4578-8761-5fdf0ba9da9c","Type":"ContainerStarted","Data":"2e2e324548459e067877d638d9cc512bb929776de432b41de743bfe82d5b94b3"}
Oct 30 20:39:07.518518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:07.518385    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xhnp" event={"ID":"9da979e4-86df-4578-8761-5fdf0ba9da9c","Type":"ContainerStarted","Data":"fb6f6ce8334566803c6d498ef9540732afdcea6b03b776d3f6a0a88a5ca5bbed"}
Oct 30 20:39:08.381426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:08.381353    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:39:08.523817 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:08.523777    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xhnp" event={"ID":"9da979e4-86df-4578-8761-5fdf0ba9da9c","Type":"ContainerStarted","Data":"564ae9fcb6d28fa95220bdc196f2b4b7e299df2a410433d53b0a252050b8b047"}
Oct 30 20:39:10.535859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:10.535816    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xhnp" event={"ID":"9da979e4-86df-4578-8761-5fdf0ba9da9c","Type":"ContainerStarted","Data":"ae85f360d37237f6c99c68a99c0b123e529920482b907a7f2dc67ad9f2d044f6"}
Oct 30 20:39:10.765098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:10.765068    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k6rvl"
Oct 30 20:39:11.361215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.361174    5115 scope.go:122] "RemoveContainer" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"
Oct 30 20:39:11.542017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.541992    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:39:11.542406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.542383    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/2.log"
Oct 30 20:39:11.542447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.542412    5115 generic.go:356] "Generic (PLEG): container finished" podID="69b633d2-97d9-4a07-9506-45658f48ee49" containerID="0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf" exitCode=255
Oct 30 20:39:11.542515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.542492    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerDied","Data":"0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf"}
Oct 30 20:39:11.542580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.542569    5115 scope.go:122] "RemoveContainer" containerID="8916c85edfe9b9eb8eff15014109b795086195eece2e8a20d9454f264b704078"
Oct 30 20:39:11.542952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.542922    5115 scope.go:122] "RemoveContainer" containerID="0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf"
Oct 30 20:39:11.543122 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:11.543103    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:11.544677 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:11.544660    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:12.547714 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:12.547689    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:39:12.548165 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:12.548015    5115 scope.go:122] "RemoveContainer" containerID="0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf"
Oct 30 20:39:12.548223 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:12.548196    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:12.997516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:12.997440    5115 patch_prober.go:29] interesting pod/image-registry-5574bcc85f-zcrr4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 20:39:12.997516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:12.997492    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:39:13.503735 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:13.503707    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8llmk"
Oct 30 20:39:16.007989 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:16.007953    5115 patch_prober.go:29] interesting pod/image-registry-c697d468-vwwrx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 20:39:16.008363 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:16.008008    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c697d468-vwwrx" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:39:18.385862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:18.385830    5115 patch_prober.go:29] interesting pod/image-registry-5574bcc85f-zcrr4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 20:39:18.386254 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:18.385876    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:39:18.510633 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:18.510605    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nd5w"
Oct 30 20:39:21.007902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:21.007862    5115 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:21.008296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:21.008260    5115 scope.go:122] "RemoveContainer" containerID="0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf"
Oct 30 20:39:21.008469 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:21.008440    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-g8jj6_openshift-console-operator(69b633d2-97d9-4a07-9506-45658f48ee49)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" podUID="69b633d2-97d9-4a07-9506-45658f48ee49"
Oct 30 20:39:22.996844 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:22.996805    5115 patch_prober.go:29] interesting pod/image-registry-5574bcc85f-zcrr4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 20:39:22.997312 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:22.996856    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:39:23.707406 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.707370    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-2hjjw-7t4bv"]
Oct 30 20:39:23.745048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.745021    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-2hjjw-7t4bv"]
Oct 30 20:39:23.745201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.745137    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.874498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.874460    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.874498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.874504    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.874716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.874589    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb85x\" (UniqueName: \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.874716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.874656    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.975825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.975749    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.975825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.975788    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.976046 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.975827    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb85x\" (UniqueName: \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.976046 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.975848    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.976213 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.976194    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.976520 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.976500    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.976594 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.976521    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:23.987166 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:23.987140    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb85x\" (UniqueName: \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\") pod \"periodic-gathering-2hjjw-7t4bv\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") " pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:24.069719 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.069689    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:39:24.373189 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.373145    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-2hjjw-7t4bv"]
Oct 30 20:39:24.377327 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:24.377300    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054db7cb_5bfa_47bd_b123_0db1ce9d9a9d.slice/crio-8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3 WatchSource:0}: Error finding container 8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3: Status 404 returned error can't find the container with id 8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3
Oct 30 20:39:24.595023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.594985    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv" event={"ID":"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d","Type":"ContainerStarted","Data":"6c8870e1fc26e7ce66a0fb78936d7aeb22d2c48ea7d95bf42b92cf586d86baca"}
Oct 30 20:39:24.595188 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.595065    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv" event={"ID":"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d","Type":"ContainerStarted","Data":"8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3"}
Oct 30 20:39:24.611655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.611608    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv" podStartSLOduration=1.611587559 podStartE2EDuration="1.611587559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:24.610575778 +0000 UTC m=+26.414470531" watchObservedRunningTime="2026-10-30 20:39:24.611587559 +0000 UTC m=+26.415482314"
Oct 30 20:39:24.641446 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.641359    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5574bcc85f-zcrr4_3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/registry/0.log"
Oct 30 20:39:24.787520 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:24.787480    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c697d468-vwwrx_431fae52-1d80-468d-bdc3-cab61bc318ad/registry/0.log"
Oct 30 20:39:25.186849 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.186822    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wb5s_514248b1-0652-4a5a-bc20-74442c71b232/node-ca/0.log"
Oct 30 20:39:25.469681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.469582    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c697d468-vwwrx" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerName="registry" containerID="cri-o://5cdf05a9c9a526994b772431adf44207d6ab1d17b6816ec6bf0d891e444bddf6" gracePeriod=30
Oct 30 20:39:25.587041 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.587011    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6987c8f769-xrp2s_79fa788b-5742-40c8-9fa5-7e2cc2cd2005/router/0.log"
Oct 30 20:39:25.600500 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.600471    5115 generic.go:356] "Generic (PLEG): container finished" podID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerID="5cdf05a9c9a526994b772431adf44207d6ab1d17b6816ec6bf0d891e444bddf6" exitCode=0
Oct 30 20:39:25.600629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.600554    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c697d468-vwwrx" event={"ID":"431fae52-1d80-468d-bdc3-cab61bc318ad","Type":"ContainerDied","Data":"5cdf05a9c9a526994b772431adf44207d6ab1d17b6816ec6bf0d891e444bddf6"}
Oct 30 20:39:25.737486 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.737419    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:39:25.791242 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791209    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791247    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791279    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791295    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791327    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791407    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791460    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791507    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") pod \"431fae52-1d80-468d-bdc3-cab61bc318ad\" (UID: \"431fae52-1d80-468d-bdc3-cab61bc318ad\") "
Oct 30 20:39:25.791725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791669    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:25.791889 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.791813    5115 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-certificates\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.792113 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.792085    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:25.794238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.794205    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:25.794365 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.794322    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:25.794516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.794488    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:25.794794 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.794489    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "kube-api-access-6zfgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:25.794844 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.794813    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:25.799094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.799045    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted" pod "431fae52-1d80-468d-bdc3-cab61bc318ad" (UID: "431fae52-1d80-468d-bdc3-cab61bc318ad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:25.892175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892136    5115 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-bound-sa-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892169    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zfgc\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-kube-api-access-6zfgc\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892185    5115 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-image-registry-private-configuration\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892194    5115 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fae52-1d80-468d-bdc3-cab61bc318ad-registry-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892204    5115 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fae52-1d80-468d-bdc3-cab61bc318ad-trusted-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892213    5115 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fae52-1d80-468d-bdc3-cab61bc318ad-ca-trust-extracted\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.892404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.892221    5115 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fae52-1d80-468d-bdc3-cab61bc318ad-installation-pull-secrets\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:25.935878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.935851    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-85qnr"
Oct 30 20:39:25.986823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:25.986778    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zmw72_07e031a4-99dd-4bbc-b69f-1e5c85e3ac77/serve-healthcheck-canary/0.log"
Oct 30 20:39:26.606425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:26.606390    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c697d468-vwwrx"
Oct 30 20:39:26.606425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:26.606410    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c697d468-vwwrx" event={"ID":"431fae52-1d80-468d-bdc3-cab61bc318ad","Type":"ContainerDied","Data":"205967f16a5c5d0b43bc830adbe6706da0caf7f7ffb3b77fd97436208ee74c2f"}
Oct 30 20:39:26.606966 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:26.606476    5115 scope.go:122] "RemoveContainer" containerID="5cdf05a9c9a526994b772431adf44207d6ab1d17b6816ec6bf0d891e444bddf6"
Oct 30 20:39:26.622040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:26.622013    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:39:26.626043 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:26.625980    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c697d468-vwwrx"]
Oct 30 20:39:28.366453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:28.366418    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" path="/var/lib/kubelet/pods/431fae52-1d80-468d-bdc3-cab61bc318ad/volumes"
Oct 30 20:39:28.386349 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:28.386323    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:39:30.515827 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.515792    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vjnhp"]
Oct 30 20:39:30.516225 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.516129    5115 cpu_manager.go:414] "containerMap: removing container" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerName="registry"
Oct 30 20:39:30.516225 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.516143    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerName="registry"
Oct 30 20:39:30.516293 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.516234    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="431fae52-1d80-468d-bdc3-cab61bc318ad" containerName="registry"
Oct 30 20:39:30.552083 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.552053    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.568059 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.568027    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:39:30.568203 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.568068    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:39:30.568203 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.568128    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dctv6\""
Oct 30 20:39:30.592126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.592102    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:39:30.592264 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.592204    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:39:30.620582 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620559    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-root\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620596    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620629    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-sys\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620666    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620732    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-tls\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620925 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620838    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-metrics-client-ca\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620925 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620857    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-textfile\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.620925 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620910    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-wtmp\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.621049 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.620952    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rlb\" (UniqueName: \"kubernetes.io/projected/3d3d9ac9-2519-4691-a987-19e00a1eafa3-kube-api-access-98rlb\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721275    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-root\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721329    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721371    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-sys\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721391    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-root\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721398    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721457    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-sys\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721482    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-tls\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721517    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-metrics-client-ca\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721557    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-textfile\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721571    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-wtmp\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.721610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721592    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rlb\" (UniqueName: \"kubernetes.io/projected/3d3d9ac9-2519-4691-a987-19e00a1eafa3-kube-api-access-98rlb\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.722155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721842    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-wtmp\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.722155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.721900    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-textfile\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.722155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.722098    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.722335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.722170    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3d9ac9-2519-4691-a987-19e00a1eafa3-metrics-client-ca\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.723859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.723836    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.723946 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.723881    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d3d9ac9-2519-4691-a987-19e00a1eafa3-node-exporter-tls\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.733317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.733293    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rlb\" (UniqueName: \"kubernetes.io/projected/3d3d9ac9-2519-4691-a987-19e00a1eafa3-kube-api-access-98rlb\") pod \"node-exporter-vjnhp\" (UID: \"3d3d9ac9-2519-4691-a987-19e00a1eafa3\") " pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.901026 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:30.900943    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjnhp"
Oct 30 20:39:30.942773 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:39:30.942745    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3d9ac9_2519_4691_a987_19e00a1eafa3.slice/crio-d1aa001aafdb74f75388788c47d9a00104819d7609daee1bc33f4535765febd8 WatchSource:0}: Error finding container d1aa001aafdb74f75388788c47d9a00104819d7609daee1bc33f4535765febd8: Status 404 returned error can't find the container with id d1aa001aafdb74f75388788c47d9a00104819d7609daee1bc33f4535765febd8
Oct 30 20:39:31.630083 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:31.630047    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjnhp" event={"ID":"3d3d9ac9-2519-4691-a987-19e00a1eafa3","Type":"ContainerStarted","Data":"d1aa001aafdb74f75388788c47d9a00104819d7609daee1bc33f4535765febd8"}
Oct 30 20:39:32.636323 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:32.636288    5115 generic.go:356] "Generic (PLEG): container finished" podID="3d3d9ac9-2519-4691-a987-19e00a1eafa3" containerID="f70b340bdc1aa6922d1829dc65557633da527fcea51553faee961d12f29d601d" exitCode=0
Oct 30 20:39:32.636731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:32.636377    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjnhp" event={"ID":"3d3d9ac9-2519-4691-a987-19e00a1eafa3","Type":"ContainerDied","Data":"f70b340bdc1aa6922d1829dc65557633da527fcea51553faee961d12f29d601d"}
Oct 30 20:39:33.642970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:33.642937    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjnhp" event={"ID":"3d3d9ac9-2519-4691-a987-19e00a1eafa3","Type":"ContainerStarted","Data":"0aa99ec50a5b6cb5d71a86b5aecb71c63d20d3bcd55cf3d1e0b9d7f2ddde5fe5"}
Oct 30 20:39:33.643392 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:33.642988    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjnhp" event={"ID":"3d3d9ac9-2519-4691-a987-19e00a1eafa3","Type":"ContainerStarted","Data":"c4a1af3cd4d4d04ce3b524f151ac6f79cf0704258e0431fa776ee3a9be8edcb9"}
Oct 30 20:39:33.669298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:33.669244    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vjnhp" podStartSLOduration=2.365400205 podStartE2EDuration="3.669231335s" totalImagesPullingTime="1.229465629s" totalInitContainerRuntime="74.365501ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:33.668692522 +0000 UTC m=+35.472587278" watchObservedRunningTime="2026-10-30 20:39:33.669231335 +0000 UTC m=+35.473126085"
Oct 30 20:39:35.361539 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.361503    5115 scope.go:122] "RemoveContainer" containerID="0458ab5e83ca1d6cb41628317c133ad7e32e31fab9b3763163d151b154cb5dbf"
Oct 30 20:39:35.590448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.590414    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:39:35.653332 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.653264    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:39:35.653470 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.653383    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6" event={"ID":"69b633d2-97d9-4a07-9506-45658f48ee49","Type":"ContainerStarted","Data":"2ef9927c43047839f1d2616d076213165794111a085f4ebe00bef7e74c63416f"}
Oct 30 20:39:35.653725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.653703    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:35.658208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:35.658187    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-g8jj6"
Oct 30 20:39:36.277772 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:36.277737    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:39:56.024633 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.024588    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:39:56.025097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.024794    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" podUID="23ea3055-97ae-427c-a023-3169446b3bae" containerName="insights-gathering" containerID="cri-o://14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff" gracePeriod=30
Oct 30 20:39:56.264784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.264761    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:39:56.340224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340151    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") pod \"23ea3055-97ae-427c-a023-3169446b3bae\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") "
Oct 30 20:39:56.340224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340189    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") pod \"23ea3055-97ae-427c-a023-3169446b3bae\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") "
Oct 30 20:39:56.340425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340221    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") pod \"23ea3055-97ae-427c-a023-3169446b3bae\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") "
Oct 30 20:39:56.340425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340274    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") pod \"23ea3055-97ae-427c-a023-3169446b3bae\" (UID: \"23ea3055-97ae-427c-a023-3169446b3bae\") "
Oct 30 20:39:56.340561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340470    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path" pod "23ea3055-97ae-427c-a023-3169446b3bae" (UID: "23ea3055-97ae-427c-a023-3169446b3bae"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:56.340632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340590    5115 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/23ea3055-97ae-427c-a023-3169446b3bae-archives-path\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.340692 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340631    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle" pod "23ea3055-97ae-427c-a023-3169446b3bae" (UID: "23ea3055-97ae-427c-a023-3169446b3bae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:56.340774 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.340745    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle" pod "23ea3055-97ae-427c-a023-3169446b3bae" (UID: "23ea3055-97ae-427c-a023-3169446b3bae"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:56.342482 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.342462    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk" pod "23ea3055-97ae-427c-a023-3169446b3bae" (UID: "23ea3055-97ae-427c-a023-3169446b3bae"). InnerVolumeSpecName "kube-api-access-z6jzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:56.441428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.441400    5115 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-trusted-ca-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.441428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.441426    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6jzk\" (UniqueName: \"kubernetes.io/projected/23ea3055-97ae-427c-a023-3169446b3bae-kube-api-access-z6jzk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.441619 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.441436    5115 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ea3055-97ae-427c-a023-3169446b3bae-service-ca-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.745141 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.745051    5115 generic.go:356] "Generic (PLEG): container finished" podID="23ea3055-97ae-427c-a023-3169446b3bae" containerID="14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff" exitCode=2
Oct 30 20:39:56.745141 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.745093    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" event={"ID":"23ea3055-97ae-427c-a023-3169446b3bae","Type":"ContainerDied","Data":"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"}
Oct 30 20:39:56.745352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.745139    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f" event={"ID":"23ea3055-97ae-427c-a023-3169446b3bae","Type":"ContainerDied","Data":"51eeb2ca08de71754aaf3832af074396f2c836d66217ae26669d03da69ea97af"}
Oct 30 20:39:56.745352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.745167    5115 scope.go:122] "RemoveContainer" containerID="14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"
Oct 30 20:39:56.745352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.745097    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t8d6k-rmv2f"
Oct 30 20:39:56.753387 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.753369    5115 scope.go:122] "RemoveContainer" containerID="14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"
Oct 30 20:39:56.753644 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:39:56.753624    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff\": container with ID starting with 14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff not found: ID does not exist" containerID="14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"
Oct 30 20:39:56.753696 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.753653    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff"} err="failed to get container status \"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff\": rpc error: code = NotFound desc = could not find container \"14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff\": container with ID starting with 14a608f31e60adac55b580d33fc0a570b749bc12bcd83fdda818fdcfb70d9bff not found: ID does not exist"
Oct 30 20:39:56.758972 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.758952    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:39:56.763364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:56.763342    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-t8d6k-rmv2f"]
Oct 30 20:39:58.369855 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:39:58.369828    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23ea3055-97ae-427c-a023-3169446b3bae" path="/var/lib/kubelet/pods/23ea3055-97ae-427c-a023-3169446b3bae/volumes"
Oct 30 20:40:00.609837 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.609768    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry" containerID="cri-o://77ba4626dea8742baac7a57d5c33b5e0b033477f921b4ed4277a2560c64bf01c" gracePeriod=30
Oct 30 20:40:00.761831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.761800    5115 generic.go:356] "Generic (PLEG): container finished" podID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerID="77ba4626dea8742baac7a57d5c33b5e0b033477f921b4ed4277a2560c64bf01c" exitCode=0
Oct 30 20:40:00.761999 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.761876    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" event={"ID":"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a","Type":"ContainerDied","Data":"77ba4626dea8742baac7a57d5c33b5e0b033477f921b4ed4277a2560c64bf01c"}
Oct 30 20:40:00.858448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.858420    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:40:00.976378 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976293    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976378 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976338    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976378 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976372    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976413    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976437    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976480    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976504    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976564    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") pod \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\" (UID: \"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a\") "
Oct 30 20:40:00.976958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.976930    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:00.977284 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.977201    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:00.978979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.978951    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:00.978979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.978963    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:00.979291 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.979269    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:00.979356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.979293    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:00.979394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.979368    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "kube-api-access-d8rgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:00.983857 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:00.983839    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted" pod "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" (UID: "3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:01.077509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077473    5115 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-certificates\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077503    5115 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-trusted-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077514    5115 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-ca-trust-extracted\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077544    5115 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-registry-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077554    5115 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-bound-sa-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077563    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8rgs\" (UniqueName: \"kubernetes.io/projected/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-kube-api-access-d8rgs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077574    5115 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-image-registry-private-configuration\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.077762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.077583    5115 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a-installation-pull-secrets\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.771836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.771804    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4" event={"ID":"3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a","Type":"ContainerDied","Data":"470a0f278fe8c953925797d37b7782e232de818a4c07cd78e5cb6f1de60354a3"}
Oct 30 20:40:01.772273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.771880    5115 scope.go:122] "RemoveContainer" containerID="77ba4626dea8742baac7a57d5c33b5e0b033477f921b4ed4277a2560c64bf01c"
Oct 30 20:40:01.772273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.771817    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5574bcc85f-zcrr4"
Oct 30 20:40:01.804784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.804752    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:40:01.809378 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:01.809353    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5574bcc85f-zcrr4"]
Oct 30 20:40:02.366108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:02.366072    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" path="/var/lib/kubelet/pods/3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a/volumes"
Oct 30 20:40:06.277314 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:40:06.277279    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:40:17.833161 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:17.833123    5115 generic.go:356] "Generic (PLEG): container finished" podID="3e3625a5-852d-480b-a6e8-91ab6b2778b3" containerID="61a96090a22fe0d66c01dc43442eac6c22036a4f8e0e1366cdea16f34ba801b0" exitCode=0
Oct 30 20:40:17.833518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:17.833193    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc" event={"ID":"3e3625a5-852d-480b-a6e8-91ab6b2778b3","Type":"ContainerDied","Data":"61a96090a22fe0d66c01dc43442eac6c22036a4f8e0e1366cdea16f34ba801b0"}
Oct 30 20:40:17.833518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:17.833502    5115 scope.go:122] "RemoveContainer" containerID="61a96090a22fe0d66c01dc43442eac6c22036a4f8e0e1366cdea16f34ba801b0"
Oct 30 20:40:18.839135 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:18.839091    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z97zc" event={"ID":"3e3625a5-852d-480b-a6e8-91ab6b2778b3","Type":"ContainerStarted","Data":"71d86259865e0706037fb5b27255a25b0bd135e9a0ea728c07eea1761be46e66"}
Oct 30 20:40:36.277982 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:40:36.277946    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:40:47.946847 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:47.946809    5115 generic.go:356] "Generic (PLEG): container finished" podID="054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" containerID="6c8870e1fc26e7ce66a0fb78936d7aeb22d2c48ea7d95bf42b92cf586d86baca" exitCode=0
Oct 30 20:40:47.947219 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:47.946881    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv" event={"ID":"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d","Type":"ContainerDied","Data":"6c8870e1fc26e7ce66a0fb78936d7aeb22d2c48ea7d95bf42b92cf586d86baca"}
Oct 30 20:40:49.089433 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.089400    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:40:49.160177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160140    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\" (UniqueName: \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\") pod \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") "
Oct 30 20:40:49.160177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160180    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\") pod \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") "
Oct 30 20:40:49.160402 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160229    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\") pod \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") "
Oct 30 20:40:49.160456 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160426    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\") pod \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\" (UID: \"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d\") "
Oct 30 20:40:49.160575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160547    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path" pod "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" (UID: "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:49.160650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160576    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle" pod "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" (UID: "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:49.160753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160737    5115 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-archives-path\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:49.160814 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160755    5115 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-service-ca-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:49.160865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.160819    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle" pod "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" (UID: "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:49.162243 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.162222    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x" pod "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" (UID: "054db7cb-5bfa-47bd-b123-0db1ce9d9a9d"). InnerVolumeSpecName "kube-api-access-nb85x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:49.261911 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.261809    5115 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-trusted-ca-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:49.261911 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.261856    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb85x\" (UniqueName: \"kubernetes.io/projected/054db7cb-5bfa-47bd-b123-0db1ce9d9a9d-kube-api-access-nb85x\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:49.958058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.957978    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv" event={"ID":"054db7cb-5bfa-47bd-b123-0db1ce9d9a9d","Type":"ContainerDied","Data":"8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3"}
Oct 30 20:40:49.958058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.958005    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2hjjw-7t4bv"
Oct 30 20:40:49.958058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:40:49.958026    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f3fb528f5529c2dd6cab9f43d69d32e3d7db3aaa5af2683f91a2490cfcdf1f3"
Oct 30 20:41:06.278798 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:41:06.278759    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:41:36.278027 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:41:36.277948    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:42:06.277853 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:42:06.277811    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:42:36.276784 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:42:36.276745    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:43:06.277635 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:43:06.277599    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:43:36.277348 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:43:36.277307    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:43:45.659798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.659760    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"]
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660107    5115 cpu_manager.go:414] "containerMap: removing container" podUID="23ea3055-97ae-427c-a023-3169446b3bae" containerName="insights-gathering"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660119    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23ea3055-97ae-427c-a023-3169446b3bae" containerName="insights-gathering"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660146    5115 cpu_manager.go:414] "containerMap: removing container" podUID="054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" containerName="insights-gathering"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660153    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" containerName="insights-gathering"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660161    5115 cpu_manager.go:414] "containerMap: removing container" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660166    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660222    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="054db7cb-5bfa-47bd-b123-0db1ce9d9a9d" containerName="insights-gathering"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660230    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cf9b7c1-d0db-411b-88ea-6ae6f1f03c7a" containerName="registry"
Oct 30 20:43:45.660288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.660237    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="23ea3055-97ae-427c-a023-3169446b3bae" containerName="insights-gathering"
Oct 30 20:43:45.665380 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.665360    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.668650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.668625    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:43:45.668650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.668629    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:43:45.668809 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.668700    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-llcqz\""
Oct 30 20:43:45.673039 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.673014    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"]
Oct 30 20:43:45.703911 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.703879    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.704102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.703922    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lqm\" (UniqueName: \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.704102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.703947    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.805370 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.805316    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.805370 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.805380    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lqm\" (UniqueName: \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.805665 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.805405    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.805845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.805819    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.805845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.805835    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.817261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.817234    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lqm\" (UniqueName: \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:45.984326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:45.984243    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:43:46.257357 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.257278    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"]
Oct 30 20:43:46.261243 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:46.261220    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4ce82f_02b5_4adc_ad95_543cb1e27c2d.slice/crio-c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5 WatchSource:0}: Error finding container c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5: Status 404 returned error can't find the container with id c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5
Oct 30 20:43:46.643252 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.643217    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp" event={"ID":"da4ce82f-02b5-4adc-ad95-543cb1e27c2d","Type":"ContainerStarted","Data":"c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5"}
Oct 30 20:43:46.869873 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.869834    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"]
Oct 30 20:43:46.873588 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.873503    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:46.877317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.877294    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-ckrgk\""
Oct 30 20:43:46.887418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.887392    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"]
Oct 30 20:43:46.914875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.914802    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpr9\" (UniqueName: \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:46.915028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.914876    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:46.915028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.915007    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:46.960183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.960151    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"]
Oct 30 20:43:46.963703 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.963673    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:46.966570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.966542    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-c46n9\""
Oct 30 20:43:46.974219 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:46.974193    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"]
Oct 30 20:43:47.016260 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016228    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.016440 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016274    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftf9x\" (UniqueName: \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.016440 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016355    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.016580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016465    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.016580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016506    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.016580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016559    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpr9\" (UniqueName: \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.016793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016767    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.016869 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.016845    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.028352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.028326    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpr9\" (UniqueName: \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.077746 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.077715    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"]
Oct 30 20:43:47.081689 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.081660    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.084510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.084483    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-qkdgk\""
Oct 30 20:43:47.092090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.092065    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"]
Oct 30 20:43:47.117847 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.117817    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.117997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.117867    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.117997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.117887    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mpk\" (UniqueName: \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.118091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.118009    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.118091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.118053    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftf9x\" (UniqueName: \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.118180 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.118138    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.118384 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.118364    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.118454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.118437    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.130496 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.130456    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftf9x\" (UniqueName: \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.156729 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.156700    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"]
Oct 30 20:43:47.161425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.161398    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.164323 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.164298    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-jtdrc\""
Oct 30 20:43:47.170490 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.170463    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"]
Oct 30 20:43:47.192206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.192178    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:43:47.219648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219618    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.219786 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219680    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.219786 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219746    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mpk\" (UniqueName: \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.219902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219803    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.219969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219949    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.220009 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.219991    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cb7c\" (UniqueName: \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.220185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.220162    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.220384 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.220360    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.231667 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.231645    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mpk\" (UniqueName: \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.281879 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.281846    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:43:47.321392 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.321357    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cb7c\" (UniqueName: \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.321575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.321405    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.322248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.321743    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.322248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.322213    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.322248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.322226    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.333256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.333233    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cb7c\" (UniqueName: \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.403618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.403581    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:43:47.479232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.479204    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"]
Oct 30 20:43:47.481448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.481430    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:43:47.484251 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:47.484220    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4b37e6_be9f_4fcd_9c66_7778218a1ff6.slice/crio-4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b WatchSource:0}: Error finding container 4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b: Status 404 returned error can't find the container with id 4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b
Oct 30 20:43:47.568403 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.568373    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"]
Oct 30 20:43:47.571779 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:47.571753    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421a7068_3d56_4fbe_b18d_64bd7f5b2fe7.slice/crio-bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab WatchSource:0}: Error finding container bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab: Status 404 returned error can't find the container with id bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab
Oct 30 20:43:47.648493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.648454    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5" event={"ID":"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6","Type":"ContainerStarted","Data":"4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b"}
Oct 30 20:43:47.649846 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.649814    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq" event={"ID":"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7","Type":"ContainerStarted","Data":"bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab"}
Oct 30 20:43:47.690681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.690648    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"]
Oct 30 20:43:47.694647 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:47.694614    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a81da4f_eeee_43fc_b8ab_dc69390a5ca4.slice/crio-c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e WatchSource:0}: Error finding container c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e: Status 404 returned error can't find the container with id c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e
Oct 30 20:43:47.761132 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:47.761108    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"]
Oct 30 20:43:47.763807 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:47.763781    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2097769a_b9f1_43ab_8198_a52d820432da.slice/crio-93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b WatchSource:0}: Error finding container 93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b: Status 404 returned error can't find the container with id 93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b
Oct 30 20:43:48.660015 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:48.659926    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerStarted","Data":"c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e"}
Oct 30 20:43:48.662473 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:48.662443    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z" event={"ID":"2097769a-b9f1-43ab-8198-a52d820432da","Type":"ContainerStarted","Data":"93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b"}
Oct 30 20:43:49.638440 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.638402    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"]
Oct 30 20:43:49.642123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.642077    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.645870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.645846    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:43:49.646045 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.645920    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vgmtz\""
Oct 30 20:43:49.658722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.658696    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"]
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742740    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742776    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742795    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce13999b-0475-4547-82bd-8a29bd61ec66-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742812    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742829    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742856    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmn8q\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-kube-api-access-kmn8q\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742891    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742917    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.743080 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.742931    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.843792    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmn8q\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-kube-api-access-kmn8q\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.843875    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.843918    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.843943    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844000    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844023    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844050    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce13999b-0475-4547-82bd-8a29bd61ec66-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844075    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844106    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.844561    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.845130    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.845367    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.846213    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.847109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.846845    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce13999b-0475-4547-82bd-8a29bd61ec66-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.849670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.849649    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.853159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.853136    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.856675 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.856643    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmn8q\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-kube-api-access-kmn8q\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.857655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.857613    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce13999b-0475-4547-82bd-8a29bd61ec66-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-dlnwn\" (UID: \"ce13999b-0475-4547-82bd-8a29bd61ec66\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:49.970626 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:49.970307    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:50.288928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:50.288818    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"]
Oct 30 20:43:50.294415 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:50.294384    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce13999b_0475_4547_82bd_8a29bd61ec66.slice/crio-f6620344c319e2610692e1a9ed6df8c927598fa1faf5aa63182f0be4aa3e7c5c WatchSource:0}: Error finding container f6620344c319e2610692e1a9ed6df8c927598fa1faf5aa63182f0be4aa3e7c5c: Status 404 returned error can't find the container with id f6620344c319e2610692e1a9ed6df8c927598fa1faf5aa63182f0be4aa3e7c5c
Oct 30 20:43:50.684241 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:50.684156    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" event={"ID":"ce13999b-0475-4547-82bd-8a29bd61ec66","Type":"ContainerStarted","Data":"f6620344c319e2610692e1a9ed6df8c927598fa1faf5aa63182f0be4aa3e7c5c"}
Oct 30 20:43:53.648882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.646759    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"]
Oct 30 20:43:53.652329 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.651482    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.655235 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.655211    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-5qxr8\""
Oct 30 20:43:53.665033 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.665006    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"]
Oct 30 20:43:53.682778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.682481    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.682778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.682559    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.682778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.682607    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rft6k\" (UniqueName: \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.785208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.783919    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rft6k\" (UniqueName: \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.785208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.784064    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.785208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.784096    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.785208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.784520    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.785208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.785150    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.809454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.803281    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rft6k\" (UniqueName: \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:53.989469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:53.989385    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:43:54.345354 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:54.345322    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"]
Oct 30 20:43:54.348612 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:54.348578    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f29e3a5_49c1_4483_8be2_113d195a92ae.slice/crio-37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d WatchSource:0}: Error finding container 37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d: Status 404 returned error can't find the container with id 37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d
Oct 30 20:43:54.735100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:54.734964    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd" event={"ID":"8f29e3a5-49c1-4483-8be2-113d195a92ae","Type":"ContainerStarted","Data":"37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d"}
Oct 30 20:43:56.194604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.193065    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"]
Oct 30 20:43:56.202047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.202013    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.206970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.206942    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"]
Oct 30 20:43:56.322200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.322126    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.322200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.322182    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t658w\" (UniqueName: \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.322200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.322208    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.423772 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.423728    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.423957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.423822    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t658w\" (UniqueName: \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.423957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.423861    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.424305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.424284    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.424567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.424547    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.462140 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.462106    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t658w\" (UniqueName: \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.467825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.467787    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:56.468194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.468160    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:56.468305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.468267    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:56.544694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.544657    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:43:56.766332 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.764631    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" event={"ID":"ce13999b-0475-4547-82bd-8a29bd61ec66","Type":"ContainerStarted","Data":"1629aaa045385e01a557e79b0b5a36eb126e458324eaf5c55459caca67019d98"}
Oct 30 20:43:56.896728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.896667    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podStartSLOduration=1.7275074240000001 podStartE2EDuration="7.896651999s" totalImagesPullingTime="6.169144575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:56.788586454 +0000 UTC m=+298.592481210" watchObservedRunningTime="2026-10-30 20:43:56.896651999 +0000 UTC m=+298.700546816"
Oct 30 20:43:56.897299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.897276    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"]
Oct 30 20:43:56.901190 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:43:56.901159    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f8c164_24d9_4b5c_a31d_dd9a1475007d.slice/crio-e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31 WatchSource:0}: Error finding container e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31: Status 404 returned error can't find the container with id e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31
Oct 30 20:43:56.971699 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:56.971612    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:57.773567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.773470    5115 generic.go:356] "Generic (PLEG): container finished" podID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerID="7f13b88604fd9837a69f0090622c3514639511567e5b127050b7633963738ac4" exitCode=0
Oct 30 20:43:57.774050 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.773709    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp" event={"ID":"da4ce82f-02b5-4adc-ad95-543cb1e27c2d","Type":"ContainerDied","Data":"7f13b88604fd9837a69f0090622c3514639511567e5b127050b7633963738ac4"}
Oct 30 20:43:57.776723 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.776695    5115 generic.go:356] "Generic (PLEG): container finished" podID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerID="591520a46158a287daf50f46c380cc213eccbf1d47521bab95e90728e71d8887" exitCode=0
Oct 30 20:43:57.777478 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.777462    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerDied","Data":"591520a46158a287daf50f46c380cc213eccbf1d47521bab95e90728e71d8887"}
Oct 30 20:43:57.777556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.777494    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerStarted","Data":"e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31"}
Oct 30 20:43:57.978343 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:57.978259    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:58.404669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:58.404216    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:43:58.404669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:58.404445    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:43:58.793933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:58.793593    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:43:58.797068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:43:58.794791    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:44:00.809502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.807986    5115 generic.go:356] "Generic (PLEG): container finished" podID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerID="4cfdf45f58e7dc25227924decccab2d553a2ff9030083327c1116f20affd85bc" exitCode=0
Oct 30 20:44:00.809502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.808106    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5" event={"ID":"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6","Type":"ContainerDied","Data":"4cfdf45f58e7dc25227924decccab2d553a2ff9030083327c1116f20affd85bc"}
Oct 30 20:44:00.811299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.811242    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerStarted","Data":"6104af5747ff3a79662e7bc3390396065938bee1f38072fcc5440d11fedcce3f"}
Oct 30 20:44:00.814321 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.814284    5115 generic.go:356] "Generic (PLEG): container finished" podID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerID="888424cd1880f40714f72bda27910bd965059a025d963ddbfbb40b65928e289a" exitCode=0
Oct 30 20:44:00.815354 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.815330    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq" event={"ID":"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7","Type":"ContainerDied","Data":"888424cd1880f40714f72bda27910bd965059a025d963ddbfbb40b65928e289a"}
Oct 30 20:44:00.839042 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:00.839013    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:44:01.002827 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.002783    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"]
Oct 30 20:44:01.007365 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.007342    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.016397 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.016331    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"]
Oct 30 20:44:01.085646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.085356    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.085646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.085392    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.085646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.085455    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4dd\" (UniqueName: \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.186423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.186378    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4dd\" (UniqueName: \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.186694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.186484    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.186694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.186506    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.186899 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.186879    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.186968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.186905    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.200593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.200561    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4dd\" (UniqueName: \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.333152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.333118    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:01.617887 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.617847    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"]
Oct 30 20:44:01.694347 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:01.694277    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0d7e3b_284d_4807_b547_98f7d32ec79b.slice/crio-ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12 WatchSource:0}: Error finding container ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12: Status 404 returned error can't find the container with id ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12
Oct 30 20:44:01.819773 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.819749    5115 generic.go:356] "Generic (PLEG): container finished" podID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerID="5c6a9a5a616b3dcc760c3ba9736e28f421d40f0fd2523723ee4eb8c7511a5658" exitCode=0
Oct 30 20:44:01.820161 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.819830    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd" event={"ID":"8f29e3a5-49c1-4483-8be2-113d195a92ae","Type":"ContainerDied","Data":"5c6a9a5a616b3dcc760c3ba9736e28f421d40f0fd2523723ee4eb8c7511a5658"}
Oct 30 20:44:01.821920 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.821832    5115 generic.go:356] "Generic (PLEG): container finished" podID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerID="18512ea6f70e876ee63d38982fe1e71d3b3dfe1ae7a031ef55ff3563ee8c3a54" exitCode=0
Oct 30 20:44:01.821998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.821920    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerDied","Data":"18512ea6f70e876ee63d38982fe1e71d3b3dfe1ae7a031ef55ff3563ee8c3a54"}
Oct 30 20:44:01.824103 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.824026    5115 generic.go:356] "Generic (PLEG): container finished" podID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerID="925191ecc1a9836714cc6a1814f3a521b9efa2618f98685d9661f6c9ebbeec5c" exitCode=0
Oct 30 20:44:01.824251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.824230    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp" event={"ID":"da4ce82f-02b5-4adc-ad95-543cb1e27c2d","Type":"ContainerDied","Data":"925191ecc1a9836714cc6a1814f3a521b9efa2618f98685d9661f6c9ebbeec5c"}
Oct 30 20:44:01.825947 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.825924    5115 generic.go:356] "Generic (PLEG): container finished" podID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerID="6104af5747ff3a79662e7bc3390396065938bee1f38072fcc5440d11fedcce3f" exitCode=0
Oct 30 20:44:01.826017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.825996    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerDied","Data":"6104af5747ff3a79662e7bc3390396065938bee1f38072fcc5440d11fedcce3f"}
Oct 30 20:44:01.827730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.827455    5115 generic.go:356] "Generic (PLEG): container finished" podID="2097769a-b9f1-43ab-8198-a52d820432da" containerID="8c975aa86197d32b237fae734213ab0502e58c9f49e702fd70d8d9863f03a1e9" exitCode=0
Oct 30 20:44:01.827730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.827558    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z" event={"ID":"2097769a-b9f1-43ab-8198-a52d820432da","Type":"ContainerDied","Data":"8c975aa86197d32b237fae734213ab0502e58c9f49e702fd70d8d9863f03a1e9"}
Oct 30 20:44:01.830427 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.830405    5115 generic.go:356] "Generic (PLEG): container finished" podID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerID="95c2813fdfb86c5611cc9414090d87254776fbb517be0f47e4d25a49c975b1a5" exitCode=0
Oct 30 20:44:01.830519 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.830454    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v" event={"ID":"ab0d7e3b-284d-4807-b547-98f7d32ec79b","Type":"ContainerDied","Data":"95c2813fdfb86c5611cc9414090d87254776fbb517be0f47e4d25a49c975b1a5"}
Oct 30 20:44:01.830519 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:01.830492    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v" event={"ID":"ab0d7e3b-284d-4807-b547-98f7d32ec79b","Type":"ContainerStarted","Data":"ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12"}
Oct 30 20:44:02.838652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.838615    5115 generic.go:356] "Generic (PLEG): container finished" podID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerID="b7c9baae37578fff8d9409f08b65c989f9b97c092e0ce5b88f637bf5c4ec3f30" exitCode=0
Oct 30 20:44:02.839125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.838715    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5" event={"ID":"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6","Type":"ContainerDied","Data":"b7c9baae37578fff8d9409f08b65c989f9b97c092e0ce5b88f637bf5c4ec3f30"}
Oct 30 20:44:02.843313 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.843277    5115 generic.go:356] "Generic (PLEG): container finished" podID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerID="6c2f466c19b259ec24b1bf309508843307c964a4141439d9aa9786d7305a8894" exitCode=0
Oct 30 20:44:02.843413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.843387    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerDied","Data":"6c2f466c19b259ec24b1bf309508843307c964a4141439d9aa9786d7305a8894"}
Oct 30 20:44:02.846715 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.846655    5115 generic.go:356] "Generic (PLEG): container finished" podID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerID="5f1a38c0c5b9cef360cc761151aa91cda5890aaaa83794b5e874916e985bcfb8" exitCode=0
Oct 30 20:44:02.846797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.846753    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v" event={"ID":"ab0d7e3b-284d-4807-b547-98f7d32ec79b","Type":"ContainerDied","Data":"5f1a38c0c5b9cef360cc761151aa91cda5890aaaa83794b5e874916e985bcfb8"}
Oct 30 20:44:02.852591 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.852447    5115 generic.go:356] "Generic (PLEG): container finished" podID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerID="11e0349011d9c7c5e606098956ac43f8a7af7e84eb67f20b867a585b665053cc" exitCode=0
Oct 30 20:44:02.852591 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:02.852554    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq" event={"ID":"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7","Type":"ContainerDied","Data":"11e0349011d9c7c5e606098956ac43f8a7af7e84eb67f20b867a585b665053cc"}
Oct 30 20:44:03.866577 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:03.865929    5115 generic.go:356] "Generic (PLEG): container finished" podID="2097769a-b9f1-43ab-8198-a52d820432da" containerID="036949dbe52586d38477c8b7b19a1301894103c07779f14880ade114dd9a79ad" exitCode=0
Oct 30 20:44:03.866577 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:03.866012    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z" event={"ID":"2097769a-b9f1-43ab-8198-a52d820432da","Type":"ContainerDied","Data":"036949dbe52586d38477c8b7b19a1301894103c07779f14880ade114dd9a79ad"}
Oct 30 20:44:06.331498 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:44:06.331350    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:44:06.897060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:06.896140    5115 generic.go:356] "Generic (PLEG): container finished" podID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerID="9fbc96f0a8b0516d25177faa82bff6806a8095d366707366e5a73a746f85869b" exitCode=0
Oct 30 20:44:06.897060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:06.896301    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd" event={"ID":"8f29e3a5-49c1-4483-8be2-113d195a92ae","Type":"ContainerDied","Data":"9fbc96f0a8b0516d25177faa82bff6806a8095d366707366e5a73a746f85869b"}
Oct 30 20:44:16.843884 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.843850    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"]
Oct 30 20:44:16.866845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.866813    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.883111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.883080    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 20:44:16.883296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.883258    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 20:44:16.883673 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.883651    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 20:44:16.885560 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.884942    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 20:44:16.885560 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.885185    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-hv2f2\""
Oct 30 20:44:16.886101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.886078    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 20:44:16.905209 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.905165    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"]
Oct 30 20:44:16.951197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951157    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-manifests\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.951376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951211    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.951376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951268    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-metrics-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.951376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951296    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.951376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951336    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-tmp\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.951376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.951360    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p588t\" (UniqueName: \"kubernetes.io/projected/7c744a78-b818-4d44-9604-babf5ff6bf6a-kube-api-access-p588t\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:16.985870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:16.985161    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerStarted","Data":"576710beac85720c82902d53b36c403be1432315bbd82d97657a28201d67ad0c"}
Oct 30 20:44:17.008264 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.007775    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" podStartSLOduration=1.685278515 podStartE2EDuration="21.007755176s" totalImagesPullingTime="19.322476661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:17.006118692 +0000 UTC m=+318.810013473" watchObservedRunningTime="2026-10-30 20:44:17.007755176 +0000 UTC m=+318.811649933"
Oct 30 20:44:17.052787 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.052691    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-manifests\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053129    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-manifests\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053203    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053279    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-metrics-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053328    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053363    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-tmp\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.054462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.053388    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p588t\" (UniqueName: \"kubernetes.io/projected/7c744a78-b818-4d44-9604-babf5ff6bf6a-kube-api-access-p588t\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.070608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.070498    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-metrics-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.071101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.071074    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.071517 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.071459    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c744a78-b818-4d44-9604-babf5ff6bf6a-tmp\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.071867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.071848    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c744a78-b818-4d44-9604-babf5ff6bf6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.073597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.073544    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p588t\" (UniqueName: \"kubernetes.io/projected/7c744a78-b818-4d44-9604-babf5ff6bf6a-kube-api-access-p588t\") pod \"opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm\" (UID: \"7c744a78-b818-4d44-9604-babf5ff6bf6a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.232625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.232596    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:17.691884 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.691806    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"]
Oct 30 20:44:17.695705 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:17.695668    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c744a78_b818_4d44_9604_babf5ff6bf6a.slice/crio-468c1a6df885deb8f8ae74b9d97199e6b640e67f7a45e91114b0818e67210d68 WatchSource:0}: Error finding container 468c1a6df885deb8f8ae74b9d97199e6b640e67f7a45e91114b0818e67210d68: Status 404 returned error can't find the container with id 468c1a6df885deb8f8ae74b9d97199e6b640e67f7a45e91114b0818e67210d68
Oct 30 20:44:17.998876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.998277    5115 generic.go:356] "Generic (PLEG): container finished" podID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerID="3634b33ca3141b85ffe0e9e3eff2af36e5b2a58f9892ee0eef57405a1cb59a94" exitCode=0
Oct 30 20:44:17.998876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:17.998376    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp" event={"ID":"da4ce82f-02b5-4adc-ad95-543cb1e27c2d","Type":"ContainerDied","Data":"3634b33ca3141b85ffe0e9e3eff2af36e5b2a58f9892ee0eef57405a1cb59a94"}
Oct 30 20:44:18.001724 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:18.001692    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm" event={"ID":"7c744a78-b818-4d44-9604-babf5ff6bf6a","Type":"ContainerStarted","Data":"468c1a6df885deb8f8ae74b9d97199e6b640e67f7a45e91114b0818e67210d68"}
Oct 30 20:44:18.007340 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:18.007001    5115 generic.go:356] "Generic (PLEG): container finished" podID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerID="c16606869bfb1848cae823c0f9fcf79d5dd89d473589a49d32f8162bd3883e5b" exitCode=0
Oct 30 20:44:18.007340 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:18.007137    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd" event={"ID":"8f29e3a5-49c1-4483-8be2-113d195a92ae","Type":"ContainerDied","Data":"c16606869bfb1848cae823c0f9fcf79d5dd89d473589a49d32f8162bd3883e5b"}
Oct 30 20:44:18.013152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:18.012920    5115 generic.go:356] "Generic (PLEG): container finished" podID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerID="576710beac85720c82902d53b36c403be1432315bbd82d97657a28201d67ad0c" exitCode=0
Oct 30 20:44:18.013152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:18.012974    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerDied","Data":"576710beac85720c82902d53b36c403be1432315bbd82d97657a28201d67ad0c"}
Oct 30 20:44:19.232074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.232038    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:44:19.280404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.279750    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\" (UniqueName: \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\") pod \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") "
Oct 30 20:44:19.280404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.279812    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\") pod \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") "
Oct 30 20:44:19.280404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.279887    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\") pod \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\" (UID: \"31f8c164-24d9-4b5c-a31d-dd9a1475007d\") "
Oct 30 20:44:19.283295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.281544    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle" pod "31f8c164-24d9-4b5c-a31d-dd9a1475007d" (UID: "31f8c164-24d9-4b5c-a31d-dd9a1475007d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.284557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.283410    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w" pod "31f8c164-24d9-4b5c-a31d-dd9a1475007d" (UID: "31f8c164-24d9-4b5c-a31d-dd9a1475007d"). InnerVolumeSpecName "kube-api-access-t658w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:19.286189 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.286166    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util" pod "31f8c164-24d9-4b5c-a31d-dd9a1475007d" (UID: "31f8c164-24d9-4b5c-a31d-dd9a1475007d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.293457 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.293317    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:44:19.310562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.309859    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:44:19.380961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.380924    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\") pod \"8f29e3a5-49c1-4483-8be2-113d195a92ae\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") "
Oct 30 20:44:19.380961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.380968    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\") pod \"8f29e3a5-49c1-4483-8be2-113d195a92ae\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") "
Oct 30 20:44:19.381167 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381026    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\") pod \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") "
Oct 30 20:44:19.381167 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381082    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\" (UniqueName: \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\") pod \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") "
Oct 30 20:44:19.381167 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381103    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\" (UniqueName: \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\") pod \"8f29e3a5-49c1-4483-8be2-113d195a92ae\" (UID: \"8f29e3a5-49c1-4483-8be2-113d195a92ae\") "
Oct 30 20:44:19.381167 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381137    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\") pod \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\" (UID: \"da4ce82f-02b5-4adc-ad95-543cb1e27c2d\") "
Oct 30 20:44:19.381310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381269    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t658w\" (UniqueName: \"kubernetes.io/projected/31f8c164-24d9-4b5c-a31d-dd9a1475007d-kube-api-access-t658w\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.381310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381301    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.381373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381311    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31f8c164-24d9-4b5c-a31d-dd9a1475007d-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.381944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.381906    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle" pod "8f29e3a5-49c1-4483-8be2-113d195a92ae" (UID: "8f29e3a5-49c1-4483-8be2-113d195a92ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.382458 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.382418    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle" pod "da4ce82f-02b5-4adc-ad95-543cb1e27c2d" (UID: "da4ce82f-02b5-4adc-ad95-543cb1e27c2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.384223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.384193    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k" pod "8f29e3a5-49c1-4483-8be2-113d195a92ae" (UID: "8f29e3a5-49c1-4483-8be2-113d195a92ae"). InnerVolumeSpecName "kube-api-access-rft6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:19.385183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.385146    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm" pod "da4ce82f-02b5-4adc-ad95-543cb1e27c2d" (UID: "da4ce82f-02b5-4adc-ad95-543cb1e27c2d"). InnerVolumeSpecName "kube-api-access-j2lqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:19.389040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.389006    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util" pod "8f29e3a5-49c1-4483-8be2-113d195a92ae" (UID: "8f29e3a5-49c1-4483-8be2-113d195a92ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.392320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.392256    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util" pod "da4ce82f-02b5-4adc-ad95-543cb1e27c2d" (UID: "da4ce82f-02b5-4adc-ad95-543cb1e27c2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482510    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482558    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2lqm\" (UniqueName: \"kubernetes.io/projected/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-kube-api-access-j2lqm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482571    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rft6k\" (UniqueName: \"kubernetes.io/projected/8f29e3a5-49c1-4483-8be2-113d195a92ae-kube-api-access-rft6k\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482583    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da4ce82f-02b5-4adc-ad95-543cb1e27c2d-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482597    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:19.482630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:19.482607    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f29e3a5-49c1-4483-8be2-113d195a92ae-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:20.034844 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.034805    5115 generic.go:356] "Generic (PLEG): container finished" podID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerID="ea36574e87b93ce3189cc596a1b16eda95b1b9c47ea25bc54dce63cbc8ced1fc" exitCode=0
Oct 30 20:44:20.035040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.034951    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v" event={"ID":"ab0d7e3b-284d-4807-b547-98f7d32ec79b","Type":"ContainerDied","Data":"ea36574e87b93ce3189cc596a1b16eda95b1b9c47ea25bc54dce63cbc8ced1fc"}
Oct 30 20:44:20.040773 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.040734    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd" event={"ID":"8f29e3a5-49c1-4483-8be2-113d195a92ae","Type":"ContainerDied","Data":"37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d"}
Oct 30 20:44:20.040941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.040789    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37151a2f970b43ec312f62e474c4a59d526d7fa4c3010a2d037f537b79869e8d"
Oct 30 20:44:20.040941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.040864    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644lrczd"
Oct 30 20:44:20.045107 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.045064    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc" event={"ID":"31f8c164-24d9-4b5c-a31d-dd9a1475007d","Type":"ContainerDied","Data":"e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31"}
Oct 30 20:44:20.045231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.045118    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5c1a9b8c7a5a62b5a31cafee695fee0b824283dde7d24402be817c16d6a0d31"
Oct 30 20:44:20.045231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.045202    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cddnhc"
Oct 30 20:44:20.054937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.054854    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp" event={"ID":"da4ce82f-02b5-4adc-ad95-543cb1e27c2d","Type":"ContainerDied","Data":"c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5"}
Oct 30 20:44:20.054937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.054889    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nttp"
Oct 30 20:44:20.054937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.054905    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c582c56d91e915d0fb0b041a60e100c08d2fc09b04eddb18836bddbc9c4fc2e5"
Oct 30 20:44:20.057888 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.057859    5115 generic.go:356] "Generic (PLEG): container finished" podID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerID="b166ac9c09f0f08003963ac697ecff4c1de1e6955b62000068e6a31920de1ff4" exitCode=0
Oct 30 20:44:20.058004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:20.057909    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerDied","Data":"b166ac9c09f0f08003963ac697ecff4c1de1e6955b62000068e6a31920de1ff4"}
Oct 30 20:44:21.066447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.066412    5115 generic.go:356] "Generic (PLEG): container finished" podID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerID="eb9caa1293fb6d23e1dffd96e6865c2cb680f88e1fff7560810dbad90050db10" exitCode=0
Oct 30 20:44:21.066933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.066602    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq" event={"ID":"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7","Type":"ContainerDied","Data":"eb9caa1293fb6d23e1dffd96e6865c2cb680f88e1fff7560810dbad90050db10"}
Oct 30 20:44:21.069418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.069385    5115 generic.go:356] "Generic (PLEG): container finished" podID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerID="06ef671578ed2309412962152df302c6f8b34699f00238f34895918f61fbdeeb" exitCode=0
Oct 30 20:44:21.069615 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.069506    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5" event={"ID":"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6","Type":"ContainerDied","Data":"06ef671578ed2309412962152df302c6f8b34699f00238f34895918f61fbdeeb"}
Oct 30 20:44:21.226680 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.226364    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:21.262340 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.262312    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:44:21.299170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299140    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\") pod \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") "
Oct 30 20:44:21.299319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299208    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\") pod \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") "
Oct 30 20:44:21.299319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299248    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\" (UniqueName: \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\") pod \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") "
Oct 30 20:44:21.299319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299305    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\" (UniqueName: \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\") pod \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\" (UID: \"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4\") "
Oct 30 20:44:21.299494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299366    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\") pod \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") "
Oct 30 20:44:21.299494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.299442    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\") pod \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\" (UID: \"ab0d7e3b-284d-4807-b547-98f7d32ec79b\") "
Oct 30 20:44:21.301063 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.301035    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle" pod "ab0d7e3b-284d-4807-b547-98f7d32ec79b" (UID: "ab0d7e3b-284d-4807-b547-98f7d32ec79b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:21.301795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.301754    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle" pod "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" (UID: "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:21.302127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.301970    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd" pod "ab0d7e3b-284d-4807-b547-98f7d32ec79b" (UID: "ab0d7e3b-284d-4807-b547-98f7d32ec79b"). InnerVolumeSpecName "kube-api-access-7c4dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:21.305894 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.305865    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk" pod "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" (UID: "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4"). InnerVolumeSpecName "kube-api-access-c2mpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:21.307138 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.307115    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util" pod "ab0d7e3b-284d-4807-b547-98f7d32ec79b" (UID: "ab0d7e3b-284d-4807-b547-98f7d32ec79b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:21.307325 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.307302    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util" pod "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" (UID: "1a81da4f-eeee-43fc-b8ab-dc69390a5ca4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:21.400324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400296    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:21.400464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400328    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab0d7e3b-284d-4807-b547-98f7d32ec79b-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:21.400464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400340    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:21.400464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400351    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:21.400464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400364    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c4dd\" (UniqueName: \"kubernetes.io/projected/ab0d7e3b-284d-4807-b547-98f7d32ec79b-kube-api-access-7c4dd\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:21.400464 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:21.400379    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2mpk\" (UniqueName: \"kubernetes.io/projected/1a81da4f-eeee-43fc-b8ab-dc69390a5ca4-kube-api-access-c2mpk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.076564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.076541    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v"
Oct 30 20:44:22.076876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.076548    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmmx4v" event={"ID":"ab0d7e3b-284d-4807-b547-98f7d32ec79b","Type":"ContainerDied","Data":"ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12"}
Oct 30 20:44:22.076876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.076666    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed0a073328c670e581e2577b2e02a5ab5f1b77bc82b705098ba296799304aa12"
Oct 30 20:44:22.078932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.078912    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7"
Oct 30 20:44:22.079017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.078913    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72dfp7" event={"ID":"1a81da4f-eeee-43fc-b8ab-dc69390a5ca4","Type":"ContainerDied","Data":"c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e"}
Oct 30 20:44:22.079085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.079036    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8c6ad8f4b78be292d6f42cb3bfe01e213bdf5576e1b052e374e247906f4810e"
Oct 30 20:44:22.081285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.081263    5115 generic.go:356] "Generic (PLEG): container finished" podID="2097769a-b9f1-43ab-8198-a52d820432da" containerID="53c52cfc131808048fafee877c1cd258a75d8b4e61dc6513ebae8f2579bb9013" exitCode=0
Oct 30 20:44:22.081391 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.081353    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z" event={"ID":"2097769a-b9f1-43ab-8198-a52d820432da","Type":"ContainerDied","Data":"53c52cfc131808048fafee877c1cd258a75d8b4e61dc6513ebae8f2579bb9013"}
Oct 30 20:44:22.241759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.241723    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:44:22.244403 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.244382    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:44:22.306501 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306470    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\") pod \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") "
Oct 30 20:44:22.306694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306514    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\" (UniqueName: \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\") pod \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") "
Oct 30 20:44:22.306694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306552    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\") pod \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") "
Oct 30 20:44:22.306694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306607    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\" (UniqueName: \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\") pod \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") "
Oct 30 20:44:22.306694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306641    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\") pod \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\" (UID: \"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6\") "
Oct 30 20:44:22.306918 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.306688    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\") pod \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\" (UID: \"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7\") "
Oct 30 20:44:22.307274 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.307217    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle" pod "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" (UID: "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:22.307372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.307345    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle" pod "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" (UID: "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:22.309227 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.309202    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x" pod "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" (UID: "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7"). InnerVolumeSpecName "kube-api-access-ftf9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:22.312966 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.312940    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util" pod "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" (UID: "421a7068-3d56-4fbe-b18d-64bd7f5b2fe7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:22.313679 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.313650    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9" pod "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" (UID: "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6"). InnerVolumeSpecName "kube-api-access-lkpr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:22.315318 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.315288    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util" pod "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" (UID: "7e4b37e6-be9f-4fcd-9c66-7778218a1ff6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:22.407670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407624    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkpr9\" (UniqueName: \"kubernetes.io/projected/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-kube-api-access-lkpr9\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.407670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407682    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.407927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407694    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.407927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407702    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4b37e6-be9f-4fcd-9c66-7778218a1ff6-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.407927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407711    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftf9x\" (UniqueName: \"kubernetes.io/projected/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-kube-api-access-ftf9x\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:22.407927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:22.407719    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/421a7068-3d56-4fbe-b18d-64bd7f5b2fe7-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:23.088136 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.088110    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5"
Oct 30 20:44:23.088136 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.088130    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crj8b5" event={"ID":"7e4b37e6-be9f-4fcd-9c66-7778218a1ff6","Type":"ContainerDied","Data":"4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b"}
Oct 30 20:44:23.088623 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.088179    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ffceceeb8130efab6b0c73395217c51bff6e52e81d381cb7471b44b72b7521b"
Oct 30 20:44:23.089958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.089928    5115 generic.go:356] "Generic (PLEG): container finished" podID="7c744a78-b818-4d44-9604-babf5ff6bf6a" containerID="ac0890748e04fe7e5a3b2c45add72beabda2ba10542cd584409059770c24c7b6" exitCode=0
Oct 30 20:44:23.090073 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.090016    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm" event={"ID":"7c744a78-b818-4d44-9604-babf5ff6bf6a","Type":"ContainerDied","Data":"ac0890748e04fe7e5a3b2c45add72beabda2ba10542cd584409059770c24c7b6"}
Oct 30 20:44:23.092213 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.092189    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq" event={"ID":"421a7068-3d56-4fbe-b18d-64bd7f5b2fe7","Type":"ContainerDied","Data":"bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab"}
Oct 30 20:44:23.092283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.092222    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g44mq"
Oct 30 20:44:23.092283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.092228    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd449fb057c5db1933c7011b242732360823852cb548e10c3c69ab0947b455ab"
Oct 30 20:44:23.214891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.214868    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:44:23.313766 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.313735    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\") pod \"2097769a-b9f1-43ab-8198-a52d820432da\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") "
Oct 30 20:44:23.313945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.313825    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\" (UniqueName: \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\") pod \"2097769a-b9f1-43ab-8198-a52d820432da\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") "
Oct 30 20:44:23.313945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.313864    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\") pod \"2097769a-b9f1-43ab-8198-a52d820432da\" (UID: \"2097769a-b9f1-43ab-8198-a52d820432da\") "
Oct 30 20:44:23.314456 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.314430    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle" pod "2097769a-b9f1-43ab-8198-a52d820432da" (UID: "2097769a-b9f1-43ab-8198-a52d820432da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:23.316010 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.315979    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c" pod "2097769a-b9f1-43ab-8198-a52d820432da" (UID: "2097769a-b9f1-43ab-8198-a52d820432da"). InnerVolumeSpecName "kube-api-access-5cb7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:23.318937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.318912    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util" pod "2097769a-b9f1-43ab-8198-a52d820432da" (UID: "2097769a-b9f1-43ab-8198-a52d820432da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:23.415283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.415178    5115 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-util\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:23.415283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.415218    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cb7c\" (UniqueName: \"kubernetes.io/projected/2097769a-b9f1-43ab-8198-a52d820432da-kube-api-access-5cb7c\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:23.415283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:23.415237    5115 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2097769a-b9f1-43ab-8198-a52d820432da-bundle\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:24.098949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.098920    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z"
Oct 30 20:44:24.099407 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.098919    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4cq8z" event={"ID":"2097769a-b9f1-43ab-8198-a52d820432da","Type":"ContainerDied","Data":"93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b"}
Oct 30 20:44:24.099407 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.099079    5115 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93cde3ab9184d37b935751a6f3912bb7045857c8fea751661a15fc17bcf4fa4b"
Oct 30 20:44:24.100958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.100926    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm" event={"ID":"7c744a78-b818-4d44-9604-babf5ff6bf6a","Type":"ContainerStarted","Data":"f0fe2c253181fdb288b4959c984e98ce1ddea50f29dd924b90f3c0b725e46ac3"}
Oct 30 20:44:24.101071 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.101035    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:24.139761 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:24.139703    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm" podStartSLOduration=2.759942411 podStartE2EDuration="8.1396891s" totalImagesPullingTime="4.800432343s" totalInitContainerRuntime="579.314346ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:24.138606589 +0000 UTC m=+325.942501355" watchObservedRunningTime="2026-10-30 20:44:24.1396891 +0000 UTC m=+325.943583853"
Oct 30 20:44:30.506928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.506892    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"]
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507216    5115 cpu_manager.go:414] "containerMap: removing container" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507231    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507246    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="pull"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507254    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="pull"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507267    5115 cpu_manager.go:414] "containerMap: removing container" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="pull"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507274    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="pull"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507283    5115 cpu_manager.go:414] "containerMap: removing container" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="extract"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507288    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="extract"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507302    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507310    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507321    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507326    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507338    5115 cpu_manager.go:414] "containerMap: removing container" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="extract"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507343    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="extract"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507352    5115 cpu_manager.go:414] "containerMap: removing container" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507358    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="util"
Oct 30 20:44:30.507356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507365    5115 cpu_manager.go:414] "containerMap: removing container" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507370    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507378    5115 cpu_manager.go:414] "containerMap: removing container" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507382    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507389    5115 cpu_manager.go:414] "containerMap: removing container" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507393    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507398    5115 cpu_manager.go:414] "containerMap: removing container" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507402    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507408    5115 cpu_manager.go:414] "containerMap: removing container" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507412    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507417    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507422    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507429    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507434    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507444    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507448    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507454    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507458    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507465    5115 cpu_manager.go:414] "containerMap: removing container" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507469    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507477    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507481    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507486    5115 cpu_manager.go:414] "containerMap: removing container" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507490    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="util"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507499    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507503    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507509    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507513    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507519    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507535    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="pull"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507540    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507544    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507601    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="31f8c164-24d9-4b5c-a31d-dd9a1475007d" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507611    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="421a7068-3d56-4fbe-b18d-64bd7f5b2fe7" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507618    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e4b37e6-be9f-4fcd-9c66-7778218a1ff6" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507624    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="da4ce82f-02b5-4adc-ad95-543cb1e27c2d" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507630    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="2097769a-b9f1-43ab-8198-a52d820432da" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507636    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f29e3a5-49c1-4483-8be2-113d195a92ae" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507640    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab0d7e3b-284d-4807-b547-98f7d32ec79b" containerName="extract"
Oct 30 20:44:30.507856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.507649    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a81da4f-eeee-43fc-b8ab-dc69390a5ca4" containerName="extract"
Oct 30 20:44:30.511282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.511263    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.517842 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.517812    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:44:30.517953 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.517890    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 20:44:30.517999 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.517974    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4482h\""
Oct 30 20:44:30.528056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.528027    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"]
Oct 30 20:44:30.576324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.576280    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmr2p\" (UniqueName: \"kubernetes.io/projected/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-kube-api-access-hmr2p\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.576552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.576411    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.676919 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.676880    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmr2p\" (UniqueName: \"kubernetes.io/projected/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-kube-api-access-hmr2p\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.677088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.676946    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.677295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.677277    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.689368 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.689332    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmr2p\" (UniqueName: \"kubernetes.io/projected/2a0d4e42-0ac9-4406-855c-2c94fdad89d2-kube-api-access-hmr2p\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-8scqf\" (UID: \"2a0d4e42-0ac9-4406-855c-2c94fdad89d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:30.821980 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:30.821942    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"
Oct 30 20:44:31.101659 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:31.101565    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf"]
Oct 30 20:44:31.106237 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:31.106207    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0d4e42_0ac9_4406_855c_2c94fdad89d2.slice/crio-e7b18dd141509aa6ea0730e413d0d378f982a2dbb3e2bb329821f83aa5382e69 WatchSource:0}: Error finding container e7b18dd141509aa6ea0730e413d0d378f982a2dbb3e2bb329821f83aa5382e69: Status 404 returned error can't find the container with id e7b18dd141509aa6ea0730e413d0d378f982a2dbb3e2bb329821f83aa5382e69
Oct 30 20:44:31.134589 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:31.134558    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf" event={"ID":"2a0d4e42-0ac9-4406-855c-2c94fdad89d2","Type":"ContainerStarted","Data":"e7b18dd141509aa6ea0730e413d0d378f982a2dbb3e2bb329821f83aa5382e69"}
Oct 30 20:44:34.148983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.148949    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf" event={"ID":"2a0d4e42-0ac9-4406-855c-2c94fdad89d2","Type":"ContainerStarted","Data":"780e664df1bef925ebee966122445333649ea95342f1914dc5d056ce26e07281"}
Oct 30 20:44:34.171460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.171415    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-8scqf" podStartSLOduration=2.184276586 podStartE2EDuration="4.171401455s" totalImagesPullingTime="1.987124869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:34.169755834 +0000 UTC m=+335.973650626" watchObservedRunningTime="2026-10-30 20:44:34.171401455 +0000 UTC m=+335.975296210"
Oct 30 20:44:34.429761 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.429691    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"]
Oct 30 20:44:34.434599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.432926    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.441838 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.441669    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 20:44:34.444792 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.444773    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:44:34.446841 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.446822    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-lj9ht\""
Oct 30 20:44:34.447187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.447165    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"]
Oct 30 20:44:34.510902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.510875    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrt2\" (UniqueName: \"kubernetes.io/projected/daa0b9d1-a949-4541-a1d5-c52c696648eb-kube-api-access-ddrt2\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.511066 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.510922    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daa0b9d1-a949-4541-a1d5-c52c696648eb-tmp\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.612212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.612172    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrt2\" (UniqueName: \"kubernetes.io/projected/daa0b9d1-a949-4541-a1d5-c52c696648eb-kube-api-access-ddrt2\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.612388 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.612265    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daa0b9d1-a949-4541-a1d5-c52c696648eb-tmp\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.612730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.612703    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daa0b9d1-a949-4541-a1d5-c52c696648eb-tmp\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.635046 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.635016    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrt2\" (UniqueName: \"kubernetes.io/projected/daa0b9d1-a949-4541-a1d5-c52c696648eb-kube-api-access-ddrt2\") pod \"jobset-operator-674cd59dc5-jjbsc\" (UID: \"daa0b9d1-a949-4541-a1d5-c52c696648eb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:34.761493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:34.761403    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"
Oct 30 20:44:35.058466 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:35.058440    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc"]
Oct 30 20:44:35.060955 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:35.060927    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaa0b9d1_a949_4541_a1d5_c52c696648eb.slice/crio-4e7375577c9b51e08c89758a1b031fc9c322c34873bfa44a9bb690e29bf25efd WatchSource:0}: Error finding container 4e7375577c9b51e08c89758a1b031fc9c322c34873bfa44a9bb690e29bf25efd: Status 404 returned error can't find the container with id 4e7375577c9b51e08c89758a1b031fc9c322c34873bfa44a9bb690e29bf25efd
Oct 30 20:44:35.107590 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:35.107561    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9ffc9ff9f-rwjsm"
Oct 30 20:44:35.154836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:35.154803    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc" event={"ID":"daa0b9d1-a949-4541-a1d5-c52c696648eb","Type":"ContainerStarted","Data":"4e7375577c9b51e08c89758a1b031fc9c322c34873bfa44a9bb690e29bf25efd"}
Oct 30 20:44:36.278986 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:44:36.278950    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:44:38.171242 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:38.171190    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc" event={"ID":"daa0b9d1-a949-4541-a1d5-c52c696648eb","Type":"ContainerStarted","Data":"c09776e7a6df501aca23f950bde354bfd83c1975f043d6318befa330a3e59ced"}
Oct 30 20:44:38.191339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:38.191287    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-jjbsc" podStartSLOduration=1.852371167 podStartE2EDuration="4.191272729s" totalImagesPullingTime="2.338901562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:38.188936259 +0000 UTC m=+339.992831017" watchObservedRunningTime="2026-10-30 20:44:38.191272729 +0000 UTC m=+339.995167485"
Oct 30 20:44:46.149497 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.149462    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-rkrgx"]
Oct 30 20:44:46.152627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.152609    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.166303 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.166282    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 20:44:46.166587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.166554    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 20:44:46.166773 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.166756    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hj4x4\""
Oct 30 20:44:46.171743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.171721    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-rkrgx"]
Oct 30 20:44:46.312983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.312950    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qj4f\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-kube-api-access-7qj4f\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.313160 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.313011    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-bound-sa-token\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.413932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.413851    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-bound-sa-token\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.413932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.413914    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qj4f\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-kube-api-access-7qj4f\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.425163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.425130    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-bound-sa-token\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.425271 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.425259    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qj4f\" (UniqueName: \"kubernetes.io/projected/4cd7cdaf-b880-43be-a817-3965d98a6046-kube-api-access-7qj4f\") pod \"cert-manager-597b95cb84-rkrgx\" (UID: \"4cd7cdaf-b880-43be-a817-3965d98a6046\") " pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.464009 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.463982    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-rkrgx"
Oct 30 20:44:46.750261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:46.750241    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-rkrgx"]
Oct 30 20:44:46.753197 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:46.753172    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cd7cdaf_b880_43be_a817_3965d98a6046.slice/crio-85de2c13d701c9a6b4a26e5ecf8a3e81652a0e66ca3734d6eab8a9b9926213ea WatchSource:0}: Error finding container 85de2c13d701c9a6b4a26e5ecf8a3e81652a0e66ca3734d6eab8a9b9926213ea: Status 404 returned error can't find the container with id 85de2c13d701c9a6b4a26e5ecf8a3e81652a0e66ca3734d6eab8a9b9926213ea
Oct 30 20:44:47.217865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:47.217826    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-rkrgx" event={"ID":"4cd7cdaf-b880-43be-a817-3965d98a6046","Type":"ContainerStarted","Data":"85de2c13d701c9a6b4a26e5ecf8a3e81652a0e66ca3734d6eab8a9b9926213ea"}
Oct 30 20:44:48.278863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.278823    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:44:48.305200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.305161    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.310602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.310568    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:44:48.312731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.312679    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:44:48.314803 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.314779    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:44:48.320885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.320859    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7xcmg\""
Oct 30 20:44:48.438125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.438083    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.438313 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.438139    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnk27\" (UniqueName: \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.538720 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.538627    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.538720 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.538691    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnk27\" (UniqueName: \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.539166 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.539142    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.556292 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.556253    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnk27\" (UniqueName: \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\") pod \"kuadrant-operator-controller-manager-cf8469d7b-lpwfh\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.640694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.640649    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:48.947048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:48.946510    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:44:48.950122 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:48.950087    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f07326_e668_4c58_94b0_4c4b108c6d65.slice/crio-6766415de1b202d3d80783dbefcc5754e345c1a7c64009721d1879a1c6fc515d WatchSource:0}: Error finding container 6766415de1b202d3d80783dbefcc5754e345c1a7c64009721d1879a1c6fc515d: Status 404 returned error can't find the container with id 6766415de1b202d3d80783dbefcc5754e345c1a7c64009721d1879a1c6fc515d
Oct 30 20:44:49.230580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:49.230469    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" event={"ID":"b7f07326-e668-4c58-94b0-4c4b108c6d65","Type":"ContainerStarted","Data":"6766415de1b202d3d80783dbefcc5754e345c1a7c64009721d1879a1c6fc515d"}
Oct 30 20:44:50.239511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:50.239477    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-rkrgx" event={"ID":"4cd7cdaf-b880-43be-a817-3965d98a6046","Type":"ContainerStarted","Data":"5dbbc9563027881879291c232552cfffbbb08ad6973e3e5fe31b22044a07ce81"}
Oct 30 20:44:50.257413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:50.257365    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-rkrgx" podStartSLOduration=1.370876495 podStartE2EDuration="4.257349619s" totalImagesPullingTime="2.886473124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:50.256923861 +0000 UTC m=+352.060818619" watchObservedRunningTime="2026-10-30 20:44:50.257349619 +0000 UTC m=+352.061244378"
Oct 30 20:44:52.302705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.302671    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"]
Oct 30 20:44:52.305275 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.305248    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:52.315572 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.315544    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mdfq8\""
Oct 30 20:44:52.322213 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.322147    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"]
Oct 30 20:44:52.472259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.472209    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9xff\" (UniqueName: \"kubernetes.io/projected/65baaf66-0a6b-4a37-825c-5ff6459c47e7-kube-api-access-z9xff\") pod \"authorino-operator-7b7bb4bc77-86mtf\" (UID: \"65baaf66-0a6b-4a37-825c-5ff6459c47e7\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:52.573211 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.573122    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9xff\" (UniqueName: \"kubernetes.io/projected/65baaf66-0a6b-4a37-825c-5ff6459c47e7-kube-api-access-z9xff\") pod \"authorino-operator-7b7bb4bc77-86mtf\" (UID: \"65baaf66-0a6b-4a37-825c-5ff6459c47e7\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:52.589919 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.589889    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9xff\" (UniqueName: \"kubernetes.io/projected/65baaf66-0a6b-4a37-825c-5ff6459c47e7-kube-api-access-z9xff\") pod \"authorino-operator-7b7bb4bc77-86mtf\" (UID: \"65baaf66-0a6b-4a37-825c-5ff6459c47e7\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:52.620198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.620162    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:52.929912 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:52.929820    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"]
Oct 30 20:44:52.933140 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:52.933109    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65baaf66_0a6b_4a37_825c_5ff6459c47e7.slice/crio-f5b6408b6caa82d96651a01061d91fd12e5ab4086a2b38577e6c1b8130acb0d7 WatchSource:0}: Error finding container f5b6408b6caa82d96651a01061d91fd12e5ab4086a2b38577e6c1b8130acb0d7: Status 404 returned error can't find the container with id f5b6408b6caa82d96651a01061d91fd12e5ab4086a2b38577e6c1b8130acb0d7
Oct 30 20:44:53.259223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:53.259114    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" event={"ID":"b7f07326-e668-4c58-94b0-4c4b108c6d65","Type":"ContainerStarted","Data":"efc80180718d648d66dc68b00328d9fb64091eabe82038ca1c692a647c622148"}
Oct 30 20:44:53.259223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:53.259193    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:44:53.260355 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:53.260327    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf" event={"ID":"65baaf66-0a6b-4a37-825c-5ff6459c47e7","Type":"ContainerStarted","Data":"f5b6408b6caa82d96651a01061d91fd12e5ab4086a2b38577e6c1b8130acb0d7"}
Oct 30 20:44:53.283082 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:53.283032    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" podStartSLOduration=1.17497678 podStartE2EDuration="5.283018369s" totalImagesPullingTime="4.108041589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:53.281458034 +0000 UTC m=+355.085352832" watchObservedRunningTime="2026-10-30 20:44:53.283018369 +0000 UTC m=+355.086913192"
Oct 30 20:44:55.035007 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.034969    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"]
Oct 30 20:44:55.045801 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.045774    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.056037 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.055213    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2nnfz\""
Oct 30 20:44:55.056037 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.055978    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"]
Oct 30 20:44:55.196038 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196009    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196038 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196044    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196141    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196198    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196344 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196275    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196344 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196308    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196456 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196343    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q65p\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-kube-api-access-5q65p\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196444    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.196511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.196499    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.273592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.273554    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf" event={"ID":"65baaf66-0a6b-4a37-825c-5ff6459c47e7","Type":"ContainerStarted","Data":"a4c5ebb9f474d6229ec4ac41c54b186112c017208717c3dc2d619622b9ebfed8"}
Oct 30 20:44:55.273753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.273647    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:44:55.294154 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.294047    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf" podStartSLOduration=1.865051737 podStartE2EDuration="3.294032187s" totalImagesPullingTime="1.42898045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:55.291795552 +0000 UTC m=+357.095690325" watchObservedRunningTime="2026-10-30 20:44:55.294032187 +0000 UTC m=+357.097926942"
Oct 30 20:44:55.297834 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297809    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.297967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297846    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.297967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297874    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.297967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297902    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.297967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297953    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.297984    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298013    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298035    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298318 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298293    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298387 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298347    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q65p\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-kube-api-access-5q65p\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298407    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298507 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298345    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298622 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298578    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.298757 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.298737    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.300851 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.300830    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.300944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.300930    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.314492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.314458    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.315680 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.315657    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q65p\" (UniqueName: \"kubernetes.io/projected/b7a6d2e9-b069-4983-88bf-1cd4262e5048-kube-api-access-5q65p\") pod \"data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr\" (UID: \"b7a6d2e9-b069-4983-88bf-1cd4262e5048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.364704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.364662    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:55.733252 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.733172    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"]
Oct 30 20:44:55.736984 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:55.736961    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a6d2e9_b069_4983_88bf_1cd4262e5048.slice/crio-cec536211d4d8213492d4af626a96ad19a96e7493eb6188004365f862d5d20d2 WatchSource:0}: Error finding container cec536211d4d8213492d4af626a96ad19a96e7493eb6188004365f862d5d20d2: Status 404 returned error can't find the container with id cec536211d4d8213492d4af626a96ad19a96e7493eb6188004365f862d5d20d2
Oct 30 20:44:55.739229 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.739198    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:55.739314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.739263    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:55.739314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:55.739292    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:56.280124 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:56.280090    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr" event={"ID":"b7a6d2e9-b069-4983-88bf-1cd4262e5048","Type":"ContainerStarted","Data":"2d9a811b59cd3085e9746cbc25d42b9bc06208efa46e952ffad9de149570c4d2"}
Oct 30 20:44:56.280511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:56.280148    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr" event={"ID":"b7a6d2e9-b069-4983-88bf-1cd4262e5048","Type":"ContainerStarted","Data":"cec536211d4d8213492d4af626a96ad19a96e7493eb6188004365f862d5d20d2"}
Oct 30 20:44:56.305757 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:56.305670    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr" podStartSLOduration=1.305657742 podStartE2EDuration="1.305657742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:56.305330261 +0000 UTC m=+358.109225018" watchObservedRunningTime="2026-10-30 20:44:56.305657742 +0000 UTC m=+358.109552498"
Oct 30 20:44:56.366390 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:56.366354    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:56.369615 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:56.369593    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:57.220993 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.220958    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"]
Oct 30 20:44:57.224484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.224460    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.228284 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.228258    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 20:44:57.228438 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.228407    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 20:44:57.228515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.228467    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-xgkx4\""
Oct 30 20:44:57.229776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.229755    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 20:44:57.237825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.237803    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"]
Oct 30 20:44:57.285159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.285131    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:57.286163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.286145    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr"
Oct 30 20:44:57.314953 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.314918    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.315111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.314976    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl2x8\" (UniqueName: \"kubernetes.io/projected/22370cb8-0a30-4b11-aec8-332e990bfc4d-kube-api-access-wl2x8\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.315302 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.315282    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22370cb8-0a30-4b11-aec8-332e990bfc4d-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.315666 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.315341    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416119 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416085    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22370cb8-0a30-4b11-aec8-332e990bfc4d-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416131    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416152    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416208    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl2x8\" (UniqueName: \"kubernetes.io/projected/22370cb8-0a30-4b11-aec8-332e990bfc4d-kube-api-access-wl2x8\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416771 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416743    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.416915 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.416866    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22370cb8-0a30-4b11-aec8-332e990bfc4d-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.417303 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.417276    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22370cb8-0a30-4b11-aec8-332e990bfc4d-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.430913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.430876    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl2x8\" (UniqueName: \"kubernetes.io/projected/22370cb8-0a30-4b11-aec8-332e990bfc4d-kube-api-access-wl2x8\") pod \"kserve-module-controller-manager-7566cf5fc8-9zt2k\" (UID: \"22370cb8-0a30-4b11-aec8-332e990bfc4d\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.538329 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.538291    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:44:57.827972 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:57.827945    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"]
Oct 30 20:44:57.830487 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:57.830458    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22370cb8_0a30_4b11_aec8_332e990bfc4d.slice/crio-ab8401a7dc317240b6105b5a052daef487c6313df15baf34428772bf69cb155c WatchSource:0}: Error finding container ab8401a7dc317240b6105b5a052daef487c6313df15baf34428772bf69cb155c: Status 404 returned error can't find the container with id ab8401a7dc317240b6105b5a052daef487c6313df15baf34428772bf69cb155c
Oct 30 20:44:58.290590 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.290559    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k" event={"ID":"22370cb8-0a30-4b11-aec8-332e990bfc4d","Type":"ContainerStarted","Data":"ab8401a7dc317240b6105b5a052daef487c6313df15baf34428772bf69cb155c"}
Oct 30 20:44:58.344511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.344481    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"]
Oct 30 20:44:58.349094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.349068    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:44:58.365132 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.365104    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-688wn\""
Oct 30 20:44:58.425620 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.425032    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwjjl\" (UniqueName: \"kubernetes.io/projected/e2c1819d-d38b-4d86-bb9c-0e8c457ef993-kube-api-access-xwjjl\") pod \"limitador-operator-controller-manager-5778bb4449-646d5\" (UID: \"e2c1819d-d38b-4d86-bb9c-0e8c457ef993\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:44:58.457617 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.457579    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"]
Oct 30 20:44:58.526570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.526515    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjjl\" (UniqueName: \"kubernetes.io/projected/e2c1819d-d38b-4d86-bb9c-0e8c457ef993-kube-api-access-xwjjl\") pod \"limitador-operator-controller-manager-5778bb4449-646d5\" (UID: \"e2c1819d-d38b-4d86-bb9c-0e8c457ef993\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:44:58.555806 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.555722    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwjjl\" (UniqueName: \"kubernetes.io/projected/e2c1819d-d38b-4d86-bb9c-0e8c457ef993-kube-api-access-xwjjl\") pod \"limitador-operator-controller-manager-5778bb4449-646d5\" (UID: \"e2c1819d-d38b-4d86-bb9c-0e8c457ef993\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:44:58.666208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.666172    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:44:58.980005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:58.979964    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"]
Oct 30 20:44:58.984592 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:44:58.982119    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c1819d_d38b_4d86_bb9c_0e8c457ef993.slice/crio-145d68f5512e275c5f36369d91b9becd774cf2485e2fbb475eda6e32dd709f60 WatchSource:0}: Error finding container 145d68f5512e275c5f36369d91b9becd774cf2485e2fbb475eda6e32dd709f60: Status 404 returned error can't find the container with id 145d68f5512e275c5f36369d91b9becd774cf2485e2fbb475eda6e32dd709f60
Oct 30 20:44:59.298432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:44:59.298395    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5" event={"ID":"e2c1819d-d38b-4d86-bb9c-0e8c457ef993","Type":"ContainerStarted","Data":"145d68f5512e275c5f36369d91b9becd774cf2485e2fbb475eda6e32dd709f60"}
Oct 30 20:45:00.306386 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:00.306348    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k" event={"ID":"22370cb8-0a30-4b11-aec8-332e990bfc4d","Type":"ContainerStarted","Data":"137098180dc7563d7fc87e6915e6da58a24c67f33593091b5565ed23aa8490e6"}
Oct 30 20:45:00.306800 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:00.306595    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:45:00.334650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:00.334587    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k" podStartSLOduration=0.929311042 podStartE2EDuration="3.334569119s" totalImagesPullingTime="2.405258077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:00.331546801 +0000 UTC m=+362.135441577" watchObservedRunningTime="2026-10-30 20:45:00.334569119 +0000 UTC m=+362.138463876"
Oct 30 20:45:01.313355 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:01.313316    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5" event={"ID":"e2c1819d-d38b-4d86-bb9c-0e8c457ef993","Type":"ContainerStarted","Data":"684eabc9b13cf8d3c5b1a4644439722b95d8cec031c80494965becc3d334d02b"}
Oct 30 20:45:01.313863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:01.313583    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:45:01.332690 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:01.332635    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5" podStartSLOduration=1.6971366909999999 podStartE2EDuration="3.332622136s" totalImagesPullingTime="1.635485445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:01.330638402 +0000 UTC m=+363.134533178" watchObservedRunningTime="2026-10-30 20:45:01.332622136 +0000 UTC m=+363.136516892"
Oct 30 20:45:04.270108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:04.270074    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:45:06.279893 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:45:06.279856    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:45:06.282913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:06.282890    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-86mtf"
Oct 30 20:45:12.321153 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:12.321119    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-646d5"
Oct 30 20:45:21.218106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.218067    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:45:21.218920 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.218351    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" podUID="b7f07326-e668-4c58-94b0-4c4b108c6d65" containerName="manager" containerID="cri-o://efc80180718d648d66dc68b00328d9fb64091eabe82038ca1c692a647c622148" gracePeriod=10
Oct 30 20:45:21.314614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.314585    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9zt2k"
Oct 30 20:45:21.421806 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.421773    5115 generic.go:356] "Generic (PLEG): container finished" podID="b7f07326-e668-4c58-94b0-4c4b108c6d65" containerID="efc80180718d648d66dc68b00328d9fb64091eabe82038ca1c692a647c622148" exitCode=0
Oct 30 20:45:21.421968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.421822    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" event={"ID":"b7f07326-e668-4c58-94b0-4c4b108c6d65","Type":"ContainerDied","Data":"efc80180718d648d66dc68b00328d9fb64091eabe82038ca1c692a647c622148"}
Oct 30 20:45:21.967286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:21.967256    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:45:22.025913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.025876    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\") pod \"b7f07326-e668-4c58-94b0-4c4b108c6d65\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") "
Oct 30 20:45:22.026098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.025937    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\" (UniqueName: \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\") pod \"b7f07326-e668-4c58-94b0-4c4b108c6d65\" (UID: \"b7f07326-e668-4c58-94b0-4c4b108c6d65\") "
Oct 30 20:45:22.026319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.026295    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume" pod "b7f07326-e668-4c58-94b0-4c4b108c6d65" (UID: "b7f07326-e668-4c58-94b0-4c4b108c6d65"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:22.028097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.028071    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27" pod "b7f07326-e668-4c58-94b0-4c4b108c6d65" (UID: "b7f07326-e668-4c58-94b0-4c4b108c6d65"). InnerVolumeSpecName "kube-api-access-gnk27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:22.127217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.127144    5115 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f07326-e668-4c58-94b0-4c4b108c6d65-extensions-socket-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:45:22.127217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.127172    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnk27\" (UniqueName: \"kubernetes.io/projected/b7f07326-e668-4c58-94b0-4c4b108c6d65-kube-api-access-gnk27\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:45:22.429570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.429466    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"
Oct 30 20:45:22.430033 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.429465    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh" event={"ID":"b7f07326-e668-4c58-94b0-4c4b108c6d65","Type":"ContainerDied","Data":"6766415de1b202d3d80783dbefcc5754e345c1a7c64009721d1879a1c6fc515d"}
Oct 30 20:45:22.430033 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.429620    5115 scope.go:122] "RemoveContainer" containerID="efc80180718d648d66dc68b00328d9fb64091eabe82038ca1c692a647c622148"
Oct 30 20:45:22.453372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.453342    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:45:22.460119 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:22.460091    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-lpwfh"]
Oct 30 20:45:24.366301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:24.366266    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7f07326-e668-4c58-94b0-4c4b108c6d65" path="/var/lib/kubelet/pods/b7f07326-e668-4c58-94b0-4c4b108c6d65/volumes"
Oct 30 20:45:36.277795 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:45:36.277760    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:45:39.157600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.157507    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:45:39.157981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.157886    5115 cpu_manager.go:414] "containerMap: removing container" podUID="b7f07326-e668-4c58-94b0-4c4b108c6d65" containerName="manager"
Oct 30 20:45:39.157981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.157899    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7f07326-e668-4c58-94b0-4c4b108c6d65" containerName="manager"
Oct 30 20:45:39.157981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.157977    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7f07326-e668-4c58-94b0-4c4b108c6d65" containerName="manager"
Oct 30 20:45:39.165024 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.165006    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:45:39.170151 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.170125    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:45:39.171543 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.171502    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6n5tv\""
Oct 30 20:45:39.183649 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.183629    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:39.186277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.186261    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.194470 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.194449    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 20:45:39.197284 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.197259    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:39.271292 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.271259    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-thfd4\""
Oct 30 20:45:39.278251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.278225    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.278317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.278279    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22j8\" (UniqueName: \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.278379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.278363    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjgk7\" (UniqueName: \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\") pod \"authorino-56c6c9ddd5-7ghvb\" (UID: \"c59b30eb-f9bd-401d-b919-9381e52f69e8\") " pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:45:39.290959 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.290935    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:39.379504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.379461    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22j8\" (UniqueName: \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.379504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.379502    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjgk7\" (UniqueName: \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\") pod \"authorino-56c6c9ddd5-7ghvb\" (UID: \"c59b30eb-f9bd-401d-b919-9381e52f69e8\") " pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:45:39.379742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.379595    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.380222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.380202    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.390876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.390852    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjgk7\" (UniqueName: \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\") pod \"authorino-56c6c9ddd5-7ghvb\" (UID: \"c59b30eb-f9bd-401d-b919-9381e52f69e8\") " pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:45:39.391032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.390982    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22j8\" (UniqueName: \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\") pod \"limitador-limitador-74dfcfb894-6prrk\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.477727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.477651    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:45:39.499739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.499713    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:39.750642 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.750617    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:45:39.753442 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:45:39.753413    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc59b30eb_f9bd_401d_b919_9381e52f69e8.slice/crio-afcd1c0761dc96c3f0e71ab4de0456649a35340f45a9861bef6b1d4ad64bcaa3 WatchSource:0}: Error finding container afcd1c0761dc96c3f0e71ab4de0456649a35340f45a9861bef6b1d4ad64bcaa3: Status 404 returned error can't find the container with id afcd1c0761dc96c3f0e71ab4de0456649a35340f45a9861bef6b1d4ad64bcaa3
Oct 30 20:45:39.785224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:39.785197    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:39.788074 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:45:39.788044    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6444372_472e_4234_9787_43050c9e9b6e.slice/crio-cb41ed95335af5c71b6023885334adccc7c7af4eaa24b9ae85a79be947a87a3d WatchSource:0}: Error finding container cb41ed95335af5c71b6023885334adccc7c7af4eaa24b9ae85a79be947a87a3d: Status 404 returned error can't find the container with id cb41ed95335af5c71b6023885334adccc7c7af4eaa24b9ae85a79be947a87a3d
Oct 30 20:45:40.529160 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:40.529118    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" event={"ID":"a6444372-472e-4234-9787-43050c9e9b6e","Type":"ContainerStarted","Data":"cb41ed95335af5c71b6023885334adccc7c7af4eaa24b9ae85a79be947a87a3d"}
Oct 30 20:45:40.530365 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:40.530335    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" event={"ID":"c59b30eb-f9bd-401d-b919-9381e52f69e8","Type":"ContainerStarted","Data":"afcd1c0761dc96c3f0e71ab4de0456649a35340f45a9861bef6b1d4ad64bcaa3"}
Oct 30 20:45:41.540078 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:41.540039    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" event={"ID":"a6444372-472e-4234-9787-43050c9e9b6e","Type":"ContainerStarted","Data":"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"}
Oct 30 20:45:41.540554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:41.540141    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:41.563047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:41.562984    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" podStartSLOduration=1.1524335159999999 podStartE2EDuration="2.562970376s" totalImagesPullingTime="1.41053686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:41.560178176 +0000 UTC m=+403.364072951" watchObservedRunningTime="2026-10-30 20:45:41.562970376 +0000 UTC m=+403.366865189"
Oct 30 20:45:42.548749 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:42.548709    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" event={"ID":"c59b30eb-f9bd-401d-b919-9381e52f69e8","Type":"ContainerStarted","Data":"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"}
Oct 30 20:45:42.564659 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:42.564607    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" podStartSLOduration=1.591096039 podStartE2EDuration="3.564592834s" totalImagesPullingTime="1.973496795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:42.562671486 +0000 UTC m=+404.366566254" watchObservedRunningTime="2026-10-30 20:45:42.564592834 +0000 UTC m=+404.368487591"
Oct 30 20:45:51.476403 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.476369    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-c7jm5"]
Oct 30 20:45:51.484698 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.484659    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.496351 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.496324    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-cert\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.496690 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.496653    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42km\" (UniqueName: \"kubernetes.io/projected/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-kube-api-access-f42km\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.505645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.505614    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-c7jm5"]
Oct 30 20:45:51.508977 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.508940    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 20:45:51.509108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.509056    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6dgz8\""
Oct 30 20:45:51.554073 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.554041    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-r7zmp"]
Oct 30 20:45:51.557710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.557692    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.576649 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.576621    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-r7zmp"]
Oct 30 20:45:51.597639 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.597600    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42km\" (UniqueName: \"kubernetes.io/projected/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-kube-api-access-f42km\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.597821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.597667    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359e3225-1a52-4746-a68a-27b68aa1c983-tls-certs\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.597821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.597696    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxmgw\" (UniqueName: \"kubernetes.io/projected/359e3225-1a52-4746-a68a-27b68aa1c983-kube-api-access-sxmgw\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.597903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.597819    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-cert\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.600763 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.600713    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-cert\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.613470 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.613442    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42km\" (UniqueName: \"kubernetes.io/projected/c740d2a1-d9b4-478b-8245-9e5e8b19c3f6-kube-api-access-f42km\") pod \"kserve-controller-manager-776cc66d47-c7jm5\" (UID: \"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6\") " pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.619461 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.619435    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 20:45:51.619645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.619435    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4kkf2\""
Oct 30 20:45:51.639393 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.639363    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-7kxpw"]
Oct 30 20:45:51.643186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.643165    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.661629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.661596    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-7kxpw"]
Oct 30 20:45:51.698373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.698339    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359e3225-1a52-4746-a68a-27b68aa1c983-tls-certs\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.698373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.698376    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxmgw\" (UniqueName: \"kubernetes.io/projected/359e3225-1a52-4746-a68a-27b68aa1c983-kube-api-access-sxmgw\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.698640 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.698408    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-cert\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.698640 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.698444    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95cz8\" (UniqueName: \"kubernetes.io/projected/b9c31d4c-e54e-4e92-b12d-f8d887705066-kube-api-access-95cz8\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.698640 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.698472    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-metrics-certs\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.700949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.700925    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359e3225-1a52-4746-a68a-27b68aa1c983-tls-certs\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.717795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.717763    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zzlds\""
Oct 30 20:45:51.718024 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.717964    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 20:45:51.718085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.718033    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 20:45:51.718995 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.718968    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxmgw\" (UniqueName: \"kubernetes.io/projected/359e3225-1a52-4746-a68a-27b68aa1c983-kube-api-access-sxmgw\") pod \"model-serving-api-75bd89fdfc-r7zmp\" (UID: \"359e3225-1a52-4746-a68a-27b68aa1c983\") " pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.799311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.799280    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-cert\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.799493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.799324    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95cz8\" (UniqueName: \"kubernetes.io/projected/b9c31d4c-e54e-4e92-b12d-f8d887705066-kube-api-access-95cz8\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.799493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.799344    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-metrics-certs\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.801963 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.801936    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-metrics-certs\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.802153 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.801969    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c31d4c-e54e-4e92-b12d-f8d887705066-cert\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.808839 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.808810    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:51.823254 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.823224    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95cz8\" (UniqueName: \"kubernetes.io/projected/b9c31d4c-e54e-4e92-b12d-f8d887705066-kube-api-access-95cz8\") pod \"odh-model-controller-769875db56-7kxpw\" (UID: \"b9c31d4c-e54e-4e92-b12d-f8d887705066\") " pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:51.872089 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.872055    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:51.956935 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:51.956904    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:52.106465 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.106441    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-c7jm5"]
Oct 30 20:45:52.108841 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:45:52.108814    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc740d2a1_d9b4_478b_8245_9e5e8b19c3f6.slice/crio-46d8359958e255a754ef5ad91c4847227a9f49bc8c8ceddcb434bf2cd101be97 WatchSource:0}: Error finding container 46d8359958e255a754ef5ad91c4847227a9f49bc8c8ceddcb434bf2cd101be97: Status 404 returned error can't find the container with id 46d8359958e255a754ef5ad91c4847227a9f49bc8c8ceddcb434bf2cd101be97
Oct 30 20:45:52.150227 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.150205    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-r7zmp"]
Oct 30 20:45:52.152333 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:45:52.152305    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359e3225_1a52_4746_a68a_27b68aa1c983.slice/crio-cd47d4cb6e80e05eea38bc8dec7ccd4c71d1afb843e3e122460a04f336a35328 WatchSource:0}: Error finding container cd47d4cb6e80e05eea38bc8dec7ccd4c71d1afb843e3e122460a04f336a35328: Status 404 returned error can't find the container with id cd47d4cb6e80e05eea38bc8dec7ccd4c71d1afb843e3e122460a04f336a35328
Oct 30 20:45:52.235504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.235461    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-7kxpw"]
Oct 30 20:45:52.237782 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:45:52.237753    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c31d4c_e54e_4e92_b12d_f8d887705066.slice/crio-683b6131cd9adfb5fd24cf4455446b68fb62e8dd174e4c8fbac8d7bd3e50a38c WatchSource:0}: Error finding container 683b6131cd9adfb5fd24cf4455446b68fb62e8dd174e4c8fbac8d7bd3e50a38c: Status 404 returned error can't find the container with id 683b6131cd9adfb5fd24cf4455446b68fb62e8dd174e4c8fbac8d7bd3e50a38c
Oct 30 20:45:52.550138 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.550099    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:52.607460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.607424    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp" event={"ID":"359e3225-1a52-4746-a68a-27b68aa1c983","Type":"ContainerStarted","Data":"cd47d4cb6e80e05eea38bc8dec7ccd4c71d1afb843e3e122460a04f336a35328"}
Oct 30 20:45:52.608885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.608854    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5" event={"ID":"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6","Type":"ContainerStarted","Data":"46d8359958e255a754ef5ad91c4847227a9f49bc8c8ceddcb434bf2cd101be97"}
Oct 30 20:45:52.610197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:52.610169    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-7kxpw" event={"ID":"b9c31d4c-e54e-4e92-b12d-f8d887705066","Type":"ContainerStarted","Data":"683b6131cd9adfb5fd24cf4455446b68fb62e8dd174e4c8fbac8d7bd3e50a38c"}
Oct 30 20:45:53.379337 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:53.379300    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:53.379614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:53.379580    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" podUID="a6444372-472e-4234-9787-43050c9e9b6e" containerName="limitador" containerID="cri-o://9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31" gracePeriod=30
Oct 30 20:45:53.997328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:53.997299    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:54.124706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.124361    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\" (UniqueName: \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\") pod \"a6444372-472e-4234-9787-43050c9e9b6e\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") "
Oct 30 20:45:54.124706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.124465    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\" (UniqueName: \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\") pod \"a6444372-472e-4234-9787-43050c9e9b6e\" (UID: \"a6444372-472e-4234-9787-43050c9e9b6e\") "
Oct 30 20:45:54.125341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.125311    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file" pod "a6444372-472e-4234-9787-43050c9e9b6e" (UID: "a6444372-472e-4234-9787-43050c9e9b6e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:45:54.129602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.129564    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8" pod "a6444372-472e-4234-9787-43050c9e9b6e" (UID: "a6444372-472e-4234-9787-43050c9e9b6e"). InnerVolumeSpecName "kube-api-access-c22j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:54.225374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.225295    5115 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a6444372-472e-4234-9787-43050c9e9b6e-config-file\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:45:54.225374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.225331    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c22j8\" (UniqueName: \"kubernetes.io/projected/a6444372-472e-4234-9787-43050c9e9b6e-kube-api-access-c22j8\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:45:54.628168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.628130    5115 generic.go:356] "Generic (PLEG): container finished" podID="a6444372-472e-4234-9787-43050c9e9b6e" containerID="9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31" exitCode=0
Oct 30 20:45:54.628350 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.628333    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" event={"ID":"a6444372-472e-4234-9787-43050c9e9b6e","Type":"ContainerDied","Data":"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"}
Oct 30 20:45:54.628394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.628387    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk" event={"ID":"a6444372-472e-4234-9787-43050c9e9b6e","Type":"ContainerDied","Data":"cb41ed95335af5c71b6023885334adccc7c7af4eaa24b9ae85a79be947a87a3d"}
Oct 30 20:45:54.628429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.628416    5115 scope.go:122] "RemoveContainer" containerID="9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"
Oct 30 20:45:54.629239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.628619    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6prrk"
Oct 30 20:45:54.646924 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.646898    5115 scope.go:122] "RemoveContainer" containerID="9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"
Oct 30 20:45:54.647760 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:45:54.647716    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31\": container with ID starting with 9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31 not found: ID does not exist" containerID="9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"
Oct 30 20:45:54.647870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.647769    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31"} err="failed to get container status \"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31\": rpc error: code = NotFound desc = could not find container \"9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31\": container with ID starting with 9929a170afde1ced2022f0f08ef60ecb9802d52997b4304ca6e7427fba015c31 not found: ID does not exist"
Oct 30 20:45:54.667549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.667506    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:54.671584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:54.671555    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6prrk"]
Oct 30 20:45:55.637229 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.637200    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp" event={"ID":"359e3225-1a52-4746-a68a-27b68aa1c983","Type":"ContainerStarted","Data":"491e4c5a64b3eeb20cf7da586f478799092d1a9eea9491a8744e3d37edffcd4b"}
Oct 30 20:45:55.637686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.637307    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:45:55.638876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.638853    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5" event={"ID":"c740d2a1-d9b4-478b-8245-9e5e8b19c3f6","Type":"ContainerStarted","Data":"36ead2c5d52023e2fda99a04415210581b7c4502229016c618727ae326ef7b3f"}
Oct 30 20:45:55.638992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.638961    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:45:55.640666 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.640646    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:45:55.658353 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.658301    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp" podStartSLOduration=2.203681174 podStartE2EDuration="4.658286915s" totalImagesPullingTime="2.454605741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:55.654975735 +0000 UTC m=+417.458870493" watchObservedRunningTime="2026-10-30 20:45:55.658286915 +0000 UTC m=+417.462181671"
Oct 30 20:45:55.673856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.673800    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5" podStartSLOduration=1.9036025269999999 podStartE2EDuration="4.673787246s" totalImagesPullingTime="2.770184719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:55.671287256 +0000 UTC m=+417.475182030" watchObservedRunningTime="2026-10-30 20:45:55.673787246 +0000 UTC m=+417.477682001"
Oct 30 20:45:55.689724 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:55.689669    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-7kxpw" podStartSLOduration=1.36313457 podStartE2EDuration="4.68965482s" totalImagesPullingTime="3.32652025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:55.68784448 +0000 UTC m=+417.491739258" watchObservedRunningTime="2026-10-30 20:45:55.68965482 +0000 UTC m=+417.493549576"
Oct 30 20:45:56.372287 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:56.372247    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6444372-472e-4234-9787-43050c9e9b6e" path="/var/lib/kubelet/pods/a6444372-472e-4234-9787-43050c9e9b6e/volumes"
Oct 30 20:45:56.649430 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:45:56.649335    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-7kxpw" event={"ID":"b9c31d4c-e54e-4e92-b12d-f8d887705066","Type":"ContainerStarted","Data":"e4fd39f8442dacee2beb796796583f0907e0f5841f6fded9c508a708d0611089"}
Oct 30 20:46:06.278967 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:46:06.278927    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:46:06.653251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:06.653170    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp"
Oct 30 20:46:07.661237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:07.661200    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-7kxpw"
Oct 30 20:46:08.623611 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.623577    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"]
Oct 30 20:46:08.623968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.623956    5115 cpu_manager.go:414] "containerMap: removing container" podUID="a6444372-472e-4234-9787-43050c9e9b6e" containerName="limitador"
Oct 30 20:46:08.624013 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.623969    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6444372-472e-4234-9787-43050c9e9b6e" containerName="limitador"
Oct 30 20:46:08.624101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.624089    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6444372-472e-4234-9787-43050c9e9b6e" containerName="limitador"
Oct 30 20:46:08.630700 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.630669    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.640978 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.640946    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"]
Oct 30 20:46:08.642294 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.642279    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 20:46:08.642493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.642476    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 20:46:08.642595 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.642479    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 20:46:08.642688 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.642670    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wdn58\""
Oct 30 20:46:08.757074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.757033    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4m8\" (UniqueName: \"kubernetes.io/projected/33b02e5f-4f87-4c2b-894c-c16da4a3a505-kube-api-access-2q4m8\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.757511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.757092    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33b02e5f-4f87-4c2b-894c-c16da4a3a505-data\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.858096 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.858048    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4m8\" (UniqueName: \"kubernetes.io/projected/33b02e5f-4f87-4c2b-894c-c16da4a3a505-kube-api-access-2q4m8\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.858308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.858123    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33b02e5f-4f87-4c2b-894c-c16da4a3a505-data\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.858596 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.858520    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/33b02e5f-4f87-4c2b-894c-c16da4a3a505-data\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.870592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.870553    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4m8\" (UniqueName: \"kubernetes.io/projected/33b02e5f-4f87-4c2b-894c-c16da4a3a505-kube-api-access-2q4m8\") pod \"postgres-7cdbf6dc44-l4b28\" (UID: \"33b02e5f-4f87-4c2b-894c-c16da4a3a505\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:08.943658 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:08.943558    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:09.223007 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:09.222980    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"]
Oct 30 20:46:09.225715 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:46:09.225686    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b02e5f_4f87_4c2b_894c_c16da4a3a505.slice/crio-f714e0b97002556ed05395d617fb78e4351e43111fb3a8086ea2f27170c28223 WatchSource:0}: Error finding container f714e0b97002556ed05395d617fb78e4351e43111fb3a8086ea2f27170c28223: Status 404 returned error can't find the container with id f714e0b97002556ed05395d617fb78e4351e43111fb3a8086ea2f27170c28223
Oct 30 20:46:09.721958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:09.721920    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28" event={"ID":"33b02e5f-4f87-4c2b-894c-c16da4a3a505","Type":"ContainerStarted","Data":"f714e0b97002556ed05395d617fb78e4351e43111fb3a8086ea2f27170c28223"}
Oct 30 20:46:15.761128 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:15.761044    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28" event={"ID":"33b02e5f-4f87-4c2b-894c-c16da4a3a505","Type":"ContainerStarted","Data":"e33b6a05c29b1cd12bdf19d5f30aee7639f2cf2c7a17b4c0d09741aba8536d38"}
Oct 30 20:46:15.761487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:15.761165    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:15.776902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:15.776855    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28" podStartSLOduration=1.561460995 podStartE2EDuration="7.776840116s" totalImagesPullingTime="6.215379121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:15.776766945 +0000 UTC m=+437.580661711" watchObservedRunningTime="2026-10-30 20:46:15.776840116 +0000 UTC m=+437.580734869"
Oct 30 20:46:21.795344 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:21.795314    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-l4b28"
Oct 30 20:46:26.654983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:26.654951    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-c7jm5"
Oct 30 20:46:28.955302 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.955264    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:28.959449 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.959427    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:28.963538 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.963488    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 20:46:28.963538 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.963495    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dnlkn\""
Oct 30 20:46:28.963731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.963606    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 20:46:28.963731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.963651    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 20:46:28.971408 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:28.971379    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:29.044330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.044291    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmm8v\" (UniqueName: \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.044330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.044332    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.044605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.044362    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.145315 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.145271    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.145495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.145380    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmm8v\" (UniqueName: \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.145495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.145404    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.147821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.147793    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.147934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.147837    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.157760 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.157738    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmm8v\" (UniqueName: \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\") pod \"maas-controller-579cf7c6d-ztzrs\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") " pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.270494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.270456    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 20:46:29.274182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.274164    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.274282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.274261    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:29.286517 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.286472    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 20:46:29.448925 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.448888    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.449114 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.448954    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.449186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.449147    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rp2\" (UniqueName: \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.549956 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.549878    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rp2\" (UniqueName: \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.549956 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.549956    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.550145 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.549995    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.552979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.552950    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.553124 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.553001    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.554553 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.554534    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:29.556806 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:46:29.556785    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4629ab3e_282d_4f61_87a0_3ee9364452ec.slice/crio-318c83a64784e74b8e8ee8cf11b1f17f08871c1a53d1117e7adb079e48fa5beb WatchSource:0}: Error finding container 318c83a64784e74b8e8ee8cf11b1f17f08871c1a53d1117e7adb079e48fa5beb: Status 404 returned error can't find the container with id 318c83a64784e74b8e8ee8cf11b1f17f08871c1a53d1117e7adb079e48fa5beb
Oct 30 20:46:29.561890 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.561869    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rp2\" (UniqueName: \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\") pod \"maas-controller-54df5bbf78-7m69q\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") " pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.614813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.614779    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:29.845395 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.845310    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" event={"ID":"4629ab3e-282d-4f61-87a0-3ee9364452ec","Type":"ContainerStarted","Data":"318c83a64784e74b8e8ee8cf11b1f17f08871c1a53d1117e7adb079e48fa5beb"}
Oct 30 20:46:29.895390 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:29.895365    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 20:46:29.897278 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:46:29.897252    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230d4017_a4cd_43d7_ab4a_b8f3f7216997.slice/crio-9a529f426d0e2b1351bc0d0dd51a149539156fd4ca0461a7f9cf82e11039d6de WatchSource:0}: Error finding container 9a529f426d0e2b1351bc0d0dd51a149539156fd4ca0461a7f9cf82e11039d6de: Status 404 returned error can't find the container with id 9a529f426d0e2b1351bc0d0dd51a149539156fd4ca0461a7f9cf82e11039d6de
Oct 30 20:46:30.857873 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:30.857826    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-7m69q" event={"ID":"230d4017-a4cd-43d7-ab4a-b8f3f7216997","Type":"ContainerStarted","Data":"9a529f426d0e2b1351bc0d0dd51a149539156fd4ca0461a7f9cf82e11039d6de"}
Oct 30 20:46:32.872422 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.872330    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" event={"ID":"4629ab3e-282d-4f61-87a0-3ee9364452ec","Type":"ContainerStarted","Data":"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"}
Oct 30 20:46:32.872880 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.872430    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:32.873990 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.873966    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-7m69q" event={"ID":"230d4017-a4cd-43d7-ab4a-b8f3f7216997","Type":"ContainerStarted","Data":"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"}
Oct 30 20:46:32.874129 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.874112    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:32.893163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.893112    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" podStartSLOduration=2.285155357 podStartE2EDuration="4.893098349s" totalImagesPullingTime="2.607942992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:32.890336879 +0000 UTC m=+454.694231636" watchObservedRunningTime="2026-10-30 20:46:32.893098349 +0000 UTC m=+454.696993105"
Oct 30 20:46:32.910310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:32.910258    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-54df5bbf78-7m69q" podStartSLOduration=1.280859185 podStartE2EDuration="3.910246277s" totalImagesPullingTime="2.629387092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:32.909554151 +0000 UTC m=+454.713448909" watchObservedRunningTime="2026-10-30 20:46:32.910246277 +0000 UTC m=+454.714141033"
Oct 30 20:46:33.861237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.861203    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"]
Oct 30 20:46:33.865671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.865647    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:33.880945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.874015    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 20:46:33.880945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.874139    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-dngpn\""
Oct 30 20:46:33.880945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.874202    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 20:46:33.880945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.879253    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"]
Oct 30 20:46:33.902036 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.902010    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 20:46:33.993920 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.993884    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:33.994092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.993936    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77w86\" (UniqueName: \"kubernetes.io/projected/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-kube-api-access-77w86\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:33.994134 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.994106    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:33.994277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:33.994256    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.095251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.095208    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.095417 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.095282    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.095476 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.095437    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.095518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.095480    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77w86\" (UniqueName: \"kubernetes.io/projected/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-kube-api-access-77w86\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.095979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.095957    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.096273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.096247    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.097797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.097756    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.107101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.107077    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77w86\" (UniqueName: \"kubernetes.io/projected/f55318a5-e2e8-43f4-a47c-daa24f7c41ab-kube-api-access-77w86\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-bq4f9\" (UID: \"f55318a5-e2e8-43f4-a47c-daa24f7c41ab\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.194244 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.194157    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:34.476497 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.476470    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"]
Oct 30 20:46:34.478550 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:46:34.478493    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55318a5_e2e8_43f4_a47c_daa24f7c41ab.slice/crio-c26f59eddd3c7bb723c8d4e01b35057de49a1dd10e55535320c6453ac4d74156 WatchSource:0}: Error finding container c26f59eddd3c7bb723c8d4e01b35057de49a1dd10e55535320c6453ac4d74156: Status 404 returned error can't find the container with id c26f59eddd3c7bb723c8d4e01b35057de49a1dd10e55535320c6453ac4d74156
Oct 30 20:46:34.894746 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:34.894709    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9" event={"ID":"f55318a5-e2e8-43f4-a47c-daa24f7c41ab","Type":"ContainerStarted","Data":"c26f59eddd3c7bb723c8d4e01b35057de49a1dd10e55535320c6453ac4d74156"}
Oct 30 20:46:36.279901 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:46:36.279864    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:46:43.893430 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:43.893396    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:43.893963 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:43.893600    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 20:46:43.966040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:43.966005    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:43.966250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:43.966220    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" podUID="4629ab3e-282d-4f61-87a0-3ee9364452ec" containerName="manager" containerID="cri-o://ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6" gracePeriod=30
Oct 30 20:46:44.745462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.745428    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:44.816766 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.816728    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\" (UniqueName: \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\") pod \"4629ab3e-282d-4f61-87a0-3ee9364452ec\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") "
Oct 30 20:46:44.816946 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.816821    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\") pod \"4629ab3e-282d-4f61-87a0-3ee9364452ec\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") "
Oct 30 20:46:44.816946 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.816905    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\") pod \"4629ab3e-282d-4f61-87a0-3ee9364452ec\" (UID: \"4629ab3e-282d-4f61-87a0-3ee9364452ec\") "
Oct 30 20:46:44.819613 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.819561    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs" pod "4629ab3e-282d-4f61-87a0-3ee9364452ec" (UID: "4629ab3e-282d-4f61-87a0-3ee9364452ec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:44.819950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.819912    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v" pod "4629ab3e-282d-4f61-87a0-3ee9364452ec" (UID: "4629ab3e-282d-4f61-87a0-3ee9364452ec"). InnerVolumeSpecName "kube-api-access-xmm8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:46:44.820258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.820225    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert" pod "4629ab3e-282d-4f61-87a0-3ee9364452ec" (UID: "4629ab3e-282d-4f61-87a0-3ee9364452ec"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:44.918599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.918514    5115 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-webhook-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:46:44.918599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.918558    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4629ab3e-282d-4f61-87a0-3ee9364452ec-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:46:44.918599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.918568    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmm8v\" (UniqueName: \"kubernetes.io/projected/4629ab3e-282d-4f61-87a0-3ee9364452ec-kube-api-access-xmm8v\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:46:44.972857 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.972812    5115 generic.go:356] "Generic (PLEG): container finished" podID="4629ab3e-282d-4f61-87a0-3ee9364452ec" containerID="ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6" exitCode=0
Oct 30 20:46:44.973012 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.972901    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" event={"ID":"4629ab3e-282d-4f61-87a0-3ee9364452ec","Type":"ContainerDied","Data":"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"}
Oct 30 20:46:44.973012 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.972950    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ztzrs" event={"ID":"4629ab3e-282d-4f61-87a0-3ee9364452ec","Type":"ContainerDied","Data":"318c83a64784e74b8e8ee8cf11b1f17f08871c1a53d1117e7adb079e48fa5beb"}
Oct 30 20:46:44.973012 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.972983    5115 scope.go:122] "RemoveContainer" containerID="ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"
Oct 30 20:46:44.973142 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.973108    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ztzrs"
Oct 30 20:46:44.984007 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.983983    5115 scope.go:122] "RemoveContainer" containerID="ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"
Oct 30 20:46:44.984327 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:46:44.984294    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6\": container with ID starting with ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6 not found: ID does not exist" containerID="ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"
Oct 30 20:46:44.984425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.984338    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6"} err="failed to get container status \"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6\": rpc error: code = NotFound desc = could not find container \"ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6\": container with ID starting with ea68d90a5eb19ae3e7f52bcebf8acaa7fb4171d529b0bbb975733b412c3276b6 not found: ID does not exist"
Oct 30 20:46:44.996580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:44.996553    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:45.002146 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:45.002125    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ztzrs"]
Oct 30 20:46:45.979184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:45.979149    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9" event={"ID":"f55318a5-e2e8-43f4-a47c-daa24f7c41ab","Type":"ContainerStarted","Data":"9adab619e97ecd89abbe4826cee1fa6311e996b1ad0a4c1967f1bf5efc02fc66"}
Oct 30 20:46:45.979543 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:45.979346    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:46:45.996339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:45.996274    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9" podStartSLOduration=1.581310986 podStartE2EDuration="12.99625795s" totalImagesPullingTime="11.414946964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:45.995441219 +0000 UTC m=+467.799335995" watchObservedRunningTime="2026-10-30 20:46:45.99625795 +0000 UTC m=+467.800152707"
Oct 30 20:46:46.367335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:46.367294    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4629ab3e-282d-4f61-87a0-3ee9364452ec" path="/var/lib/kubelet/pods/4629ab3e-282d-4f61-87a0-3ee9364452ec/volumes"
Oct 30 20:46:56.991266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:46:56.991236    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-bq4f9"
Oct 30 20:47:06.284316 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:47:06.284276    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:47:14.835689 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:14.835646    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:47:14.836079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:14.835725    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:15.454614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.454575    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-rc85z"]
Oct 30 20:47:15.455075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.455056    5115 cpu_manager.go:414] "containerMap: removing container" podUID="4629ab3e-282d-4f61-87a0-3ee9364452ec" containerName="manager"
Oct 30 20:47:15.455169 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.455077    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4629ab3e-282d-4f61-87a0-3ee9364452ec" containerName="manager"
Oct 30 20:47:15.455169 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.455149    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="4629ab3e-282d-4f61-87a0-3ee9364452ec" containerName="manager"
Oct 30 20:47:15.640173 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.640141    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-rc85z"]
Oct 30 20:47:15.640173 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.640175    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 20:47:15.640416 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.640260    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.643435 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.643399    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 20:47:15.661043 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.661026    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 20:47:15.661148 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.661104    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.709175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.709112    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.709297 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.709201    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbjpn\" (UniqueName: \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.709297 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.709277    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.709435 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.709332    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.745310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.745286    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k976f\""
Oct 30 20:47:15.745310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.745306    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:47:15.745462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.745351    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 20:47:15.747138 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.747116    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-rc85z"]
Oct 30 20:47:15.747338 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:47:15.747321    5115 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lh8fk tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-rc85z" podUID="c8e3ee9d-dbc7-4278-9ceb-43b599733a66"
Oct 30 20:47:15.810140 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810112    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.810277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810142    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbjpn\" (UniqueName: \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.810277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810187    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.810277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810210    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.810277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810232    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.810277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810254    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8fk\" (UniqueName: \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.810928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.810910    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.812596 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.812566    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.812684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.812639    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.861750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.861728    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbjpn\" (UniqueName: \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\") pod \"maas-api-5db654b954-64xd4\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") " pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:15.910840 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.910803    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.910840 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.910843    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8fk\" (UniqueName: \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.913158 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.913137    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:15.928333 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:15.928310    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8fk\" (UniqueName: \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\") pod \"authorino-6889cbd8c4-rc85z\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") " pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:16.001888 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.001826    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:16.143653 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.143633    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:16.152536 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.152498    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:16.213281 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.213257    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\" (UniqueName: \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\") pod \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") "
Oct 30 20:47:16.213393 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.213303    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\" (UniqueName: \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\") pod \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\" (UID: \"c8e3ee9d-dbc7-4278-9ceb-43b599733a66\") "
Oct 30 20:47:16.215226 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.215201    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk" pod "c8e3ee9d-dbc7-4278-9ceb-43b599733a66" (UID: "c8e3ee9d-dbc7-4278-9ceb-43b599733a66"). InnerVolumeSpecName "kube-api-access-lh8fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:47:16.215314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.215224    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert" pod "c8e3ee9d-dbc7-4278-9ceb-43b599733a66" (UID: "c8e3ee9d-dbc7-4278-9ceb-43b599733a66"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:47:16.289330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.289307    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 20:47:16.290888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:47:16.290865    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5990cf8b_b58b_4096_a31a_bee92a8f29a9.slice/crio-3b7cf70e736734f5e933d6b9d8c6fa9367e94c13cb4f8c679b67615484dfd21d WatchSource:0}: Error finding container 3b7cf70e736734f5e933d6b9d8c6fa9367e94c13cb4f8c679b67615484dfd21d: Status 404 returned error can't find the container with id 3b7cf70e736734f5e933d6b9d8c6fa9367e94c13cb4f8c679b67615484dfd21d
Oct 30 20:47:16.314664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.314642    5115 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-tls-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:47:16.314664 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:16.314665    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh8fk\" (UniqueName: \"kubernetes.io/projected/c8e3ee9d-dbc7-4278-9ceb-43b599733a66-kube-api-access-lh8fk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:47:17.152891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.152810    5115 generic.go:356] "Generic (PLEG): container finished" podID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerID="1629aaa045385e01a557e79b0b5a36eb126e458324eaf5c55459caca67019d98" exitCode=0
Oct 30 20:47:17.153444 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.152887    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" event={"ID":"ce13999b-0475-4547-82bd-8a29bd61ec66","Type":"ContainerDied","Data":"1629aaa045385e01a557e79b0b5a36eb126e458324eaf5c55459caca67019d98"}
Oct 30 20:47:17.153444 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.153403    5115 scope.go:122] "RemoveContainer" containerID="1629aaa045385e01a557e79b0b5a36eb126e458324eaf5c55459caca67019d98"
Oct 30 20:47:17.154488 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.154281    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-rc85z"
Oct 30 20:47:17.154488 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.154315    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" event={"ID":"5990cf8b-b58b-4096-a31a-bee92a8f29a9","Type":"ContainerStarted","Data":"3b7cf70e736734f5e933d6b9d8c6fa9367e94c13cb4f8c679b67615484dfd21d"}
Oct 30 20:47:17.154841 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.154807    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:47:17.154933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.154892    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:47:17.154977 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.154936    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:47:17.208390 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.208356    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-rc85z"]
Oct 30 20:47:17.211766 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.211730    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-rc85z"]
Oct 30 20:47:17.655556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.655302    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:47:17.666339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:17.665987    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" podUID="c59b30eb-f9bd-401d-b919-9381e52f69e8" containerName="authorino" containerID="cri-o://2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159" gracePeriod=30
Oct 30 20:47:18.052409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.052375    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:47:18.149965 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.149929    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\" (UniqueName: \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\") pod \"c59b30eb-f9bd-401d-b919-9381e52f69e8\" (UID: \"c59b30eb-f9bd-401d-b919-9381e52f69e8\") "
Oct 30 20:47:18.152347 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.152320    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7" pod "c59b30eb-f9bd-401d-b919-9381e52f69e8" (UID: "c59b30eb-f9bd-401d-b919-9381e52f69e8"). InnerVolumeSpecName "kube-api-access-vjgk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:47:18.163443 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.163412    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" event={"ID":"ce13999b-0475-4547-82bd-8a29bd61ec66","Type":"ContainerStarted","Data":"c185896bc948a3ebeffe1b4e9cd3f4e34fb39b536bde91e5f3723f310a296650"}
Oct 30 20:47:18.164831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.164807    5115 generic.go:356] "Generic (PLEG): container finished" podID="c59b30eb-f9bd-401d-b919-9381e52f69e8" containerID="2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159" exitCode=0
Oct 30 20:47:18.164941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.164849    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb"
Oct 30 20:47:18.164941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.164891    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" event={"ID":"c59b30eb-f9bd-401d-b919-9381e52f69e8","Type":"ContainerDied","Data":"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"}
Oct 30 20:47:18.165054 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.164939    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-7ghvb" event={"ID":"c59b30eb-f9bd-401d-b919-9381e52f69e8","Type":"ContainerDied","Data":"afcd1c0761dc96c3f0e71ab4de0456649a35340f45a9861bef6b1d4ad64bcaa3"}
Oct 30 20:47:18.165054 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.164962    5115 scope.go:122] "RemoveContainer" containerID="2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"
Oct 30 20:47:18.175338 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.175323    5115 scope.go:122] "RemoveContainer" containerID="2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"
Oct 30 20:47:18.175604 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:47:18.175585    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159\": container with ID starting with 2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159 not found: ID does not exist" containerID="2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"
Oct 30 20:47:18.175693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.175616    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159"} err="failed to get container status \"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159\": rpc error: code = NotFound desc = could not find container \"2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159\": container with ID starting with 2e5ecf87adb3f49befd04f33af16e2c64d79feeee9b9aa1a13892949198b5159 not found: ID does not exist"
Oct 30 20:47:18.197250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.197226    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:47:18.200955 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.200923    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-7ghvb"]
Oct 30 20:47:18.250984 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.250886    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjgk7\" (UniqueName: \"kubernetes.io/projected/c59b30eb-f9bd-401d-b919-9381e52f69e8-kube-api-access-vjgk7\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:47:18.367135 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.367102    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c59b30eb-f9bd-401d-b919-9381e52f69e8" path="/var/lib/kubelet/pods/c59b30eb-f9bd-401d-b919-9381e52f69e8/volumes"
Oct 30 20:47:18.367467 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.367454    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8e3ee9d-dbc7-4278-9ceb-43b599733a66" path="/var/lib/kubelet/pods/c8e3ee9d-dbc7-4278-9ceb-43b599733a66/volumes"
Oct 30 20:47:18.971656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.971561    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:47:18.971823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.971791    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:47:18.971897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:18.971850    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:47:19.171680 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:19.171647    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" event={"ID":"5990cf8b-b58b-4096-a31a-bee92a8f29a9","Type":"ContainerStarted","Data":"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"}
Oct 30 20:47:19.172215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:19.171772    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:19.189971 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:19.189917    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" podStartSLOduration=1.83237027 podStartE2EDuration="4.1899025s" totalImagesPullingTime="2.35753223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:19.189560458 +0000 UTC m=+500.993455231" watchObservedRunningTime="2026-10-30 20:47:19.1899025 +0000 UTC m=+500.993797257"
Oct 30 20:47:19.971933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:19.971902    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:47:19.972082 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:19.971962    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:47:20.971983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:20.971945    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:47:20.972415 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:20.971998    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:47:21.971901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:21.971867    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:47:21.972087 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:21.971922    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:47:22.971326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:22.971288    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:47:22.971489 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:22.971344    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:47:23.975031 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:23.974998    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:47:23.975496 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:23.975473    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:47:23.976149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:23.976127    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn"
Oct 30 20:47:25.184494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:47:25.184466    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 20:47:36.278672 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:47:36.278637    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:48:06.278631 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:48:06.278592    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:48:10.151266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.151227    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6mk6g"]
Oct 30 20:48:10.152434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.152405    5115 cpu_manager.go:414] "containerMap: removing container" podUID="c59b30eb-f9bd-401d-b919-9381e52f69e8" containerName="authorino"
Oct 30 20:48:10.152434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.152431    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c59b30eb-f9bd-401d-b919-9381e52f69e8" containerName="authorino"
Oct 30 20:48:10.152674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.152568    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="c59b30eb-f9bd-401d-b919-9381e52f69e8" containerName="authorino"
Oct 30 20:48:10.157586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.157565    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.163483 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.163459    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 20:48:10.166204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.166181    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 20:48:10.166796 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.166761    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6mk6g"]
Oct 30 20:48:10.167081 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.167061    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c25rl\""
Oct 30 20:48:10.167304 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.167248    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 20:48:10.299951 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.299918    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.300119 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.299980    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.300119 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.300033    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.300190 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.300165    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-home\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.300232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.300214    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgsqq\" (UniqueName: \"kubernetes.io/projected/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-kube-api-access-pgsqq\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.300314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.300300    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401659 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401565    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401659 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401602    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401747    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-home\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401824    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgsqq\" (UniqueName: \"kubernetes.io/projected/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-kube-api-access-pgsqq\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401880    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.401939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.401916    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.402068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.402049    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.402188 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.402165    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-home\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.402278 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.402262    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.404051 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.404033    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.404320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.404303    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.414161 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.413814    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgsqq\" (UniqueName: \"kubernetes.io/projected/4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1-kube-api-access-pgsqq\") pod \"echo-simulator-kserve-64b6f8f96c-6mk6g\" (UID: \"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.473924 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.473883    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:10.755921 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:10.755891    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6mk6g"]
Oct 30 20:48:10.757993 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:10.757964    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4e4ff8_8e01_4476_ad23_d86ae3a40ac1.slice/crio-144b3aa37ce6100a3e514a60b62ec0e34638d8d86474088d5f07f298a437c907 WatchSource:0}: Error finding container 144b3aa37ce6100a3e514a60b62ec0e34638d8d86474088d5f07f298a437c907: Status 404 returned error can't find the container with id 144b3aa37ce6100a3e514a60b62ec0e34638d8d86474088d5f07f298a437c907
Oct 30 20:48:11.454875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:11.454797    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g" event={"ID":"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1","Type":"ContainerStarted","Data":"144b3aa37ce6100a3e514a60b62ec0e34638d8d86474088d5f07f298a437c907"}
Oct 30 20:48:12.464592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:12.464439    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g" event={"ID":"4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1","Type":"ContainerStarted","Data":"3b9d8a5d40ef9a0238ddcc9684d35750a878f1142c13df4546d1e559ec0281cc"}
Oct 30 20:48:12.474695 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:12.474664    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:12.536986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:12.536909    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g" podStartSLOduration=0.933832217 podStartE2EDuration="2.536887839s" totalImagesPullingTime="1.603055622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:12.533584285 +0000 UTC m=+554.337479069" watchObservedRunningTime="2026-10-30 20:48:12.536887839 +0000 UTC m=+554.340782597"
Oct 30 20:48:13.794172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.794135    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"]
Oct 30 20:48:13.797786 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.797764    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.808601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.808574    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"]
Oct 30 20:48:13.811949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.811920    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 30 20:48:13.935561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935506    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.935743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935566    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.935743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935654    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.935743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935687    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.935743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935722    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ebf960-5308-4e3b-99ff-488bc3311a13-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:13.935743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:13.935739    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm2cd\" (UniqueName: \"kubernetes.io/projected/c7ebf960-5308-4e3b-99ff-488bc3311a13-kube-api-access-cm2cd\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036459 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036419    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036463    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036594    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036647    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036699    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ebf960-5308-4e3b-99ff-488bc3311a13-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036719    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm2cd\" (UniqueName: \"kubernetes.io/projected/c7ebf960-5308-4e3b-99ff-488bc3311a13-kube-api-access-cm2cd\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.036970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036942    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.037013 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.036976    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.037051 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.037007    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.038943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.038913    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ebf960-5308-4e3b-99ff-488bc3311a13-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.039222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.039205    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ebf960-5308-4e3b-99ff-488bc3311a13-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.049310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.049250    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm2cd\" (UniqueName: \"kubernetes.io/projected/c7ebf960-5308-4e3b-99ff-488bc3311a13-kube-api-access-cm2cd\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp\" (UID: \"c7ebf960-5308-4e3b-99ff-488bc3311a13\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.110479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.110443    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:14.391987 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.391958    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"]
Oct 30 20:48:14.394254 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:14.394212    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7ebf960_5308_4e3b_99ff_488bc3311a13.slice/crio-4a3fd70244ceb473aef7f0fbd94dd7c9d6955b06ec145d000fcf9b60a5555c61 WatchSource:0}: Error finding container 4a3fd70244ceb473aef7f0fbd94dd7c9d6955b06ec145d000fcf9b60a5555c61: Status 404 returned error can't find the container with id 4a3fd70244ceb473aef7f0fbd94dd7c9d6955b06ec145d000fcf9b60a5555c61
Oct 30 20:48:14.476386 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:14.476350    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" event={"ID":"c7ebf960-5308-4e3b-99ff-488bc3311a13","Type":"ContainerStarted","Data":"4a3fd70244ceb473aef7f0fbd94dd7c9d6955b06ec145d000fcf9b60a5555c61"}
Oct 30 20:48:15.238679 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.237169    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"]
Oct 30 20:48:15.243800 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.243777    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.256285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.256228    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 20:48:15.259107 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.259018    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"]
Oct 30 20:48:15.358097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358049    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.358310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358111    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.358310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358149    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.358310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358188    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.358310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358227    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpg9\" (UniqueName: \"kubernetes.io/projected/6954dc2e-9cb9-4330-9281-bc63ce255bb9-kube-api-access-zhpg9\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.358310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.358276    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459188 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459143    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459212    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpg9\" (UniqueName: \"kubernetes.io/projected/6954dc2e-9cb9-4330-9281-bc63ce255bb9-kube-api-access-zhpg9\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459260    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459415    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459442    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459474    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459699 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459638    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.459757 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.459703    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.460491 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.460464    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.462974 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.462945    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6954dc2e-9cb9-4330-9281-bc63ce255bb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.463183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.463162    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6954dc2e-9cb9-4330-9281-bc63ce255bb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.472328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.472298    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpg9\" (UniqueName: \"kubernetes.io/projected/6954dc2e-9cb9-4330-9281-bc63ce255bb9-kube-api-access-zhpg9\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r\" (UID: \"6954dc2e-9cb9-4330-9281-bc63ce255bb9\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.573087 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.572756    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:15.871772 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:15.871741    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"]
Oct 30 20:48:15.873256 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:15.873230    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6954dc2e_9cb9_4330_9281_bc63ce255bb9.slice/crio-ac1abecd8db265197da1bca872839772a38f460b5f3c2595ae2dca359b6233eb WatchSource:0}: Error finding container ac1abecd8db265197da1bca872839772a38f460b5f3c2595ae2dca359b6233eb: Status 404 returned error can't find the container with id ac1abecd8db265197da1bca872839772a38f460b5f3c2595ae2dca359b6233eb
Oct 30 20:48:16.492335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.492250    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" event={"ID":"c7ebf960-5308-4e3b-99ff-488bc3311a13","Type":"ContainerStarted","Data":"9d786acade3579fa1e59605fb6010f3906eca43829eadefb59ca172f5c479fcd"}
Oct 30 20:48:16.494005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.493976    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r" event={"ID":"6954dc2e-9cb9-4330-9281-bc63ce255bb9","Type":"ContainerStarted","Data":"e9c9da1ac18d020f02e34195be6de6aaf2a0eba0ca11d344b09aaddcb0ad6a8a"}
Oct 30 20:48:16.494111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.494030    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r" event={"ID":"6954dc2e-9cb9-4330-9281-bc63ce255bb9","Type":"ContainerStarted","Data":"ac1abecd8db265197da1bca872839772a38f460b5f3c2595ae2dca359b6233eb"}
Oct 30 20:48:16.513778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.513732    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podStartSLOduration=2.162109639 podStartE2EDuration="3.513721386s" totalImagesPullingTime="1.351611747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:16.51217111 +0000 UTC m=+558.316065888" watchObservedRunningTime="2026-10-30 20:48:16.513721386 +0000 UTC m=+558.317616142"
Oct 30 20:48:16.532973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.532929    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r" podStartSLOduration=1.225455919 podStartE2EDuration="1.532918153s" totalImagesPullingTime="307.462234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:16.532203926 +0000 UTC m=+558.336098682" watchObservedRunningTime="2026-10-30 20:48:16.532918153 +0000 UTC m=+558.336812908"
Oct 30 20:48:16.573428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.573397    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:16.607536 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.607490    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"]
Oct 30 20:48:16.611187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.611163    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.620976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.620955    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 20:48:16.625873 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.625848    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"]
Oct 30 20:48:16.676045 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676010    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.676186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676067    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.676186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676126    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.676269 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676213    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzmd9\" (UniqueName: \"kubernetes.io/projected/42072638-49f4-4d89-83db-694b8d828a1a-kube-api-access-jzmd9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.676269 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676239    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42072638-49f4-4d89-83db-694b8d828a1a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.676340 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.676317    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777341    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777378    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777417    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzmd9\" (UniqueName: \"kubernetes.io/projected/42072638-49f4-4d89-83db-694b8d828a1a-kube-api-access-jzmd9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777444    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42072638-49f4-4d89-83db-694b8d828a1a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777470    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777535    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777893 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777865    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.777957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.777941    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.778174 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.778152    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.780170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.780145    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42072638-49f4-4d89-83db-694b8d828a1a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.780272 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.780255    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42072638-49f4-4d89-83db-694b8d828a1a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.792068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.792039    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzmd9\" (UniqueName: \"kubernetes.io/projected/42072638-49f4-4d89-83db-694b8d828a1a-kube-api-access-jzmd9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-jmqjw\" (UID: \"42072638-49f4-4d89-83db-694b8d828a1a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:16.924217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:16.924186    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:17.111486 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:17.111399    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:17.256825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:17.256789    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"]
Oct 30 20:48:17.272575 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:17.272516    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42072638_49f4_4d89_83db_694b8d828a1a.slice/crio-73508379f6c87bfff1f53bcc5b5a1ebadad83709d850c8342e8fa1e4cab7bc86 WatchSource:0}: Error finding container 73508379f6c87bfff1f53bcc5b5a1ebadad83709d850c8342e8fa1e4cab7bc86: Status 404 returned error can't find the container with id 73508379f6c87bfff1f53bcc5b5a1ebadad83709d850c8342e8fa1e4cab7bc86
Oct 30 20:48:17.503490 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:17.503402    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw" event={"ID":"42072638-49f4-4d89-83db-694b8d828a1a","Type":"ContainerStarted","Data":"73508379f6c87bfff1f53bcc5b5a1ebadad83709d850c8342e8fa1e4cab7bc86"}
Oct 30 20:48:18.510401 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:18.510365    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw" event={"ID":"42072638-49f4-4d89-83db-694b8d828a1a","Type":"ContainerStarted","Data":"c2d5a3024d65c67632da2307d740530e7df2e48fa58bd12fed9049d6a2a667b5"}
Oct 30 20:48:18.532479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:18.532411    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw" podStartSLOduration=2.225826433 podStartE2EDuration="2.532395458s" totalImagesPullingTime="306.569025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:18.530765935 +0000 UTC m=+560.334660711" watchObservedRunningTime="2026-10-30 20:48:18.532395458 +0000 UTC m=+560.336290205"
Oct 30 20:48:18.924513 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:18.924466    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:19.462216 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.462186    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"]
Oct 30 20:48:19.465934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.465914    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.490299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.490270    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"]
Oct 30 20:48:19.492787 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.492763    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 20:48:19.511075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511044    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blf94\" (UniqueName: \"kubernetes.io/projected/6529e2bd-2ff0-473d-8bee-89ca41036578-kube-api-access-blf94\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.511379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511098    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.511379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511193    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6529e2bd-2ff0-473d-8bee-89ca41036578-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.511379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511223    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.511379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511265    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.511379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.511351    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.611869 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.611836    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.611887    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6529e2bd-2ff0-473d-8bee-89ca41036578-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.611973    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612040    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612072    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612286    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612431 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612409    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612460    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.612567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.612549    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blf94\" (UniqueName: \"kubernetes.io/projected/6529e2bd-2ff0-473d-8bee-89ca41036578-kube-api-access-blf94\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.614207 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.614184    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6529e2bd-2ff0-473d-8bee-89ca41036578-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.614606 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.614587    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6529e2bd-2ff0-473d-8bee-89ca41036578-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.652388 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.652357    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blf94\" (UniqueName: \"kubernetes.io/projected/6529e2bd-2ff0-473d-8bee-89ca41036578-kube-api-access-blf94\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4\" (UID: \"6529e2bd-2ff0-473d-8bee-89ca41036578\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:19.778716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:19.778685    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:20.067414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.067386    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"]
Oct 30 20:48:20.069110 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:20.069081    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6529e2bd_2ff0_473d_8bee_89ca41036578.slice/crio-0b4b5b183d7ceff9f9c1ad09bdf04cf016517e0e616a7a4d5dc29b3a3dfecc17 WatchSource:0}: Error finding container 0b4b5b183d7ceff9f9c1ad09bdf04cf016517e0e616a7a4d5dc29b3a3dfecc17: Status 404 returned error can't find the container with id 0b4b5b183d7ceff9f9c1ad09bdf04cf016517e0e616a7a4d5dc29b3a3dfecc17
Oct 30 20:48:20.474031 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.473989    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:20.492558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.492508    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:20.523272 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.523234    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4" event={"ID":"6529e2bd-2ff0-473d-8bee-89ca41036578","Type":"ContainerStarted","Data":"df4f84843ae6b7e8e14d4573bad66cea5418efbec15c731065c5c69c0fbc5ddf"}
Oct 30 20:48:20.523684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.523290    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4" event={"ID":"6529e2bd-2ff0-473d-8bee-89ca41036578","Type":"ContainerStarted","Data":"0b4b5b183d7ceff9f9c1ad09bdf04cf016517e0e616a7a4d5dc29b3a3dfecc17"}
Oct 30 20:48:20.535336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.535294    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g"
Oct 30 20:48:20.639434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.639363    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4" podStartSLOduration=1.318091387 podStartE2EDuration="1.639343263s" totalImagesPullingTime="321.251876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:20.639055468 +0000 UTC m=+562.442950221" watchObservedRunningTime="2026-10-30 20:48:20.639343263 +0000 UTC m=+562.443238019"
Oct 30 20:48:20.779842 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:20.779804    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:24.111602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:24.111561    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:24.124518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:24.124493    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:24.560296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:24.560261    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:48:25.573798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:25.573770    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:25.586033 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:25.586008    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:26.572460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:26.572435    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r"
Oct 30 20:48:26.924802 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:26.924711    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:26.937443 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:26.937418    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:27.578934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:27.578906    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw"
Oct 30 20:48:29.779482 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:29.779446    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:29.791844 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:29.791811    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:30.597600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:30.597571    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4"
Oct 30 20:48:36.278616 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:48:36.278576    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:48:38.742294 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.742214    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:48:38.750666 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.750637    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:38.759565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.759535    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:48:38.766074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.766042    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 20:48:38.766885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.766849    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-mxq9z\""
Oct 30 20:48:38.769416 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.769396    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 20:48:38.902072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.902033    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:38.902252 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:38.902205    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlkk\" (UniqueName: \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.003285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.003193    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlkk\" (UniqueName: \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.003285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.003267    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.005768 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.005738    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.020453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.020417    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlkk\" (UniqueName: \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\") pod \"ai-gateway-controller-5f6dd4f69f-k26sl\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.068023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.067993    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:39.348583 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.348560    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:48:39.350647 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:39.350617    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440ce1b8_3a43_44d5_8fec_f792a72526f7.slice/crio-a958906ee0c853c3e239b382aa41165aef18a5f2912a27b1a4b772c86302a262 WatchSource:0}: Error finding container a958906ee0c853c3e239b382aa41165aef18a5f2912a27b1a4b772c86302a262: Status 404 returned error can't find the container with id a958906ee0c853c3e239b382aa41165aef18a5f2912a27b1a4b772c86302a262
Oct 30 20:48:39.639732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:39.639649    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" event={"ID":"440ce1b8-3a43-44d5-8fec-f792a72526f7","Type":"ContainerStarted","Data":"a958906ee0c853c3e239b382aa41165aef18a5f2912a27b1a4b772c86302a262"}
Oct 30 20:48:42.660106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:42.660072    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" event={"ID":"440ce1b8-3a43-44d5-8fec-f792a72526f7","Type":"ContainerStarted","Data":"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"}
Oct 30 20:48:42.660539 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:42.660144    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:43.510444 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.510388    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" podStartSLOduration=3.2555925820000002 podStartE2EDuration="5.510374633s" totalImagesPullingTime="2.254782051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:42.678323829 +0000 UTC m=+584.482218606" watchObservedRunningTime="2026-10-30 20:48:43.510374633 +0000 UTC m=+585.314269388"
Oct 30 20:48:43.511250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.511232    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-gl64r"]
Oct 30 20:48:43.515209 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.515193    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.523160 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.522666    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 20:48:43.527197 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.527114    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-gl64r"]
Oct 30 20:48:43.555621 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.555583    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"]
Oct 30 20:48:43.559595 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.559570    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.580222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.580154    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bsk5x\""
Oct 30 20:48:43.583792 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.583762    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"]
Oct 30 20:48:43.650361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.650320    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bkf\" (UniqueName: \"kubernetes.io/projected/662e9cb2-69fc-45d5-8b0f-746b87c45e62-kube-api-access-j4bkf\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.650627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.650372    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hktlh\" (UniqueName: \"kubernetes.io/projected/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-kube-api-access-hktlh\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.650627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.650513    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662e9cb2-69fc-45d5-8b0f-746b87c45e62-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.650627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.650581    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-plugins-config-volume\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.751273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.751236    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-plugins-config-volume\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.751759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.751324    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bkf\" (UniqueName: \"kubernetes.io/projected/662e9cb2-69fc-45d5-8b0f-746b87c45e62-kube-api-access-j4bkf\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.751759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.751358    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hktlh\" (UniqueName: \"kubernetes.io/projected/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-kube-api-access-hktlh\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.751759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.751411    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662e9cb2-69fc-45d5-8b0f-746b87c45e62-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.752161 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.752140    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/662e9cb2-69fc-45d5-8b0f-746b87c45e62-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.752237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.752147    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-plugins-config-volume\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.764564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.764464    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bkf\" (UniqueName: \"kubernetes.io/projected/662e9cb2-69fc-45d5-8b0f-746b87c45e62-kube-api-access-j4bkf\") pod \"payload-pre-processing-7b98bb678c-25lwm\" (UID: \"662e9cb2-69fc-45d5-8b0f-746b87c45e62\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:43.764707 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.764568    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hktlh\" (UniqueName: \"kubernetes.io/projected/b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8-kube-api-access-hktlh\") pod \"payload-processing-5f78687d5b-gl64r\" (UID: \"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8\") " pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.832071 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.832037    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:43.873708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:43.873662    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:44.117348 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:44.117317    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-gl64r"]
Oct 30 20:48:44.120999 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:44.120967    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f8a0c7_d37e_4cd1_a773_a016bda1b7d8.slice/crio-85bad0c0e96fee19c00045c84b79ce4f3e666ea1827100550d9a3fe8d5a995d5 WatchSource:0}: Error finding container 85bad0c0e96fee19c00045c84b79ce4f3e666ea1827100550d9a3fe8d5a995d5: Status 404 returned error can't find the container with id 85bad0c0e96fee19c00045c84b79ce4f3e666ea1827100550d9a3fe8d5a995d5
Oct 30 20:48:44.179559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:44.179507    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"]
Oct 30 20:48:44.183349 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:44.182586    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662e9cb2_69fc_45d5_8b0f_746b87c45e62.slice/crio-99fe0c4fdae6e4d46dcb786fb0d2337b67c2577f0e749d1f4e6131ac87580761 WatchSource:0}: Error finding container 99fe0c4fdae6e4d46dcb786fb0d2337b67c2577f0e749d1f4e6131ac87580761: Status 404 returned error can't find the container with id 99fe0c4fdae6e4d46dcb786fb0d2337b67c2577f0e749d1f4e6131ac87580761
Oct 30 20:48:44.673037 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:44.673003    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm" event={"ID":"662e9cb2-69fc-45d5-8b0f-746b87c45e62","Type":"ContainerStarted","Data":"99fe0c4fdae6e4d46dcb786fb0d2337b67c2577f0e749d1f4e6131ac87580761"}
Oct 30 20:48:44.674324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:44.674294    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r" event={"ID":"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8","Type":"ContainerStarted","Data":"85bad0c0e96fee19c00045c84b79ce4f3e666ea1827100550d9a3fe8d5a995d5"}
Oct 30 20:48:46.689200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.689163    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm" event={"ID":"662e9cb2-69fc-45d5-8b0f-746b87c45e62","Type":"ContainerStarted","Data":"dfc1fa00a6416202b2530fb6ea560e9e7b9e51392483e2fcf0d9e95ba33a7c3e"}
Oct 30 20:48:46.689637 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.689377    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:46.690780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.690749    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r" event={"ID":"b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8","Type":"ContainerStarted","Data":"cecf0eab601551e303b31ad7c8905049247b0230bec64829c56d2f4c136f679d"}
Oct 30 20:48:46.690888 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.690819    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:46.708056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.708008    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm" podStartSLOduration=1.297430827 podStartE2EDuration="3.707996479s" totalImagesPullingTime="2.410565652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:46.705858184 +0000 UTC m=+588.509752941" watchObservedRunningTime="2026-10-30 20:48:46.707996479 +0000 UTC m=+588.511891235"
Oct 30 20:48:46.724942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:46.724881    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r" podStartSLOduration=1.288249138 podStartE2EDuration="3.724862176s" totalImagesPullingTime="2.436613038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:46.722334802 +0000 UTC m=+588.526229557" watchObservedRunningTime="2026-10-30 20:48:46.724862176 +0000 UTC m=+588.528756937"
Oct 30 20:48:53.668409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:53.668373    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:48:53.964298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:53.964207    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"]
Oct 30 20:48:53.968461 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:53.968438    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:53.980582 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:53.980555    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"]
Oct 30 20:48:54.155000 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.154947    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-metrics-certs\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.155000 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.155008    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfljf\" (UniqueName: \"kubernetes.io/projected/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-kube-api-access-mfljf\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.256375 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.256283    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-metrics-certs\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.256375 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.256327    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfljf\" (UniqueName: \"kubernetes.io/projected/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-kube-api-access-mfljf\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.258948 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.258916    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-metrics-certs\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.282231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.282200    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfljf\" (UniqueName: \"kubernetes.io/projected/ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4-kube-api-access-mfljf\") pod \"ai-gateway-controller-5d4f8585d4-9vb62\" (UID: \"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4\") " pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.282987 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.282967    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:54.565588 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.565561    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"]
Oct 30 20:48:54.567985 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:48:54.567954    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9e825f_bfab_4a9e_a191_cc3fbb4c32f4.slice/crio-17e2b37989a89914eb6ada47ebf4f1561c846cd3553b2f003675cd998f8b4c1b WatchSource:0}: Error finding container 17e2b37989a89914eb6ada47ebf4f1561c846cd3553b2f003675cd998f8b4c1b: Status 404 returned error can't find the container with id 17e2b37989a89914eb6ada47ebf4f1561c846cd3553b2f003675cd998f8b4c1b
Oct 30 20:48:54.739009 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:54.738971    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62" event={"ID":"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4","Type":"ContainerStarted","Data":"17e2b37989a89914eb6ada47ebf4f1561c846cd3553b2f003675cd998f8b4c1b"}
Oct 30 20:48:55.746176 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:55.746139    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62" event={"ID":"ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4","Type":"ContainerStarted","Data":"d2128ed905ef4b8d7a455060ae875057558561f2ec6946748d5cbabc032b1250"}
Oct 30 20:48:55.746601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:55.746325    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:48:55.769713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:55.769658    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62" podStartSLOduration=2.405219945 podStartE2EDuration="2.769643494s" totalImagesPullingTime="364.423549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:55.768698139 +0000 UTC m=+597.572592915" watchObservedRunningTime="2026-10-30 20:48:55.769643494 +0000 UTC m=+597.573538251"
Oct 30 20:48:57.700225 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:57.700196    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-gl64r"
Oct 30 20:48:57.700668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:57.700358    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-25lwm"
Oct 30 20:48:58.469817 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:58.469782    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:48:58.470129 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:48:58.470110    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:49:06.278624 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:49:06.278587    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:49:06.755097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:06.755011    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d4f8585d4-9vb62"
Oct 30 20:49:06.811049 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:06.811015    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:49:06.811405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:06.811268    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" podUID="440ce1b8-3a43-44d5-8fec-f792a72526f7" containerName="manager" containerID="cri-o://f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6" gracePeriod=30
Oct 30 20:49:07.070913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.070888    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:49:07.177143 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.177107    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\" (UniqueName: \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\") pod \"440ce1b8-3a43-44d5-8fec-f792a72526f7\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") "
Oct 30 20:49:07.177327 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.177312    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\") pod \"440ce1b8-3a43-44d5-8fec-f792a72526f7\" (UID: \"440ce1b8-3a43-44d5-8fec-f792a72526f7\") "
Oct 30 20:49:07.179287 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.179253    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk" pod "440ce1b8-3a43-44d5-8fec-f792a72526f7" (UID: "440ce1b8-3a43-44d5-8fec-f792a72526f7"). InnerVolumeSpecName "kube-api-access-4wlkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:07.179422 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.179346    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs" pod "440ce1b8-3a43-44d5-8fec-f792a72526f7" (UID: "440ce1b8-3a43-44d5-8fec-f792a72526f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:07.278871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.278818    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wlkk\" (UniqueName: \"kubernetes.io/projected/440ce1b8-3a43-44d5-8fec-f792a72526f7-kube-api-access-4wlkk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:49:07.278871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.278862    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/440ce1b8-3a43-44d5-8fec-f792a72526f7-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:49:07.821828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.821793    5115 generic.go:356] "Generic (PLEG): container finished" podID="440ce1b8-3a43-44d5-8fec-f792a72526f7" containerID="f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6" exitCode=0
Oct 30 20:49:07.822025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.821843    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"
Oct 30 20:49:07.822025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.821882    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" event={"ID":"440ce1b8-3a43-44d5-8fec-f792a72526f7","Type":"ContainerDied","Data":"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"}
Oct 30 20:49:07.822025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.821941    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl" event={"ID":"440ce1b8-3a43-44d5-8fec-f792a72526f7","Type":"ContainerDied","Data":"a958906ee0c853c3e239b382aa41165aef18a5f2912a27b1a4b772c86302a262"}
Oct 30 20:49:07.822025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.821968    5115 scope.go:122] "RemoveContainer" containerID="f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"
Oct 30 20:49:07.831759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.831741    5115 scope.go:122] "RemoveContainer" containerID="f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"
Oct 30 20:49:07.832044 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:49:07.832023    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6\": container with ID starting with f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6 not found: ID does not exist" containerID="f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"
Oct 30 20:49:07.832115 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.832055    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6"} err="failed to get container status \"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6\": rpc error: code = NotFound desc = could not find container \"f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6\": container with ID starting with f3fc0a574232b767324ba22b6abb9e776047c82105a2f9837c58ca5a8a1b60f6 not found: ID does not exist"
Oct 30 20:49:07.843077 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.843049    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:49:07.847397 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:07.847374    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-k26sl"]
Oct 30 20:49:08.367785 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:08.367754    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="440ce1b8-3a43-44d5-8fec-f792a72526f7" path="/var/lib/kubelet/pods/440ce1b8-3a43-44d5-8fec-f792a72526f7/volumes"
Oct 30 20:49:36.280105 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:49:36.280067    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:49:50.940107 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.940062    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:49:50.940690 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.940657    5115 cpu_manager.go:414] "containerMap: removing container" podUID="440ce1b8-3a43-44d5-8fec-f792a72526f7" containerName="manager"
Oct 30 20:49:50.940690 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.940673    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="440ce1b8-3a43-44d5-8fec-f792a72526f7" containerName="manager"
Oct 30 20:49:50.940797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.940776    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="440ce1b8-3a43-44d5-8fec-f792a72526f7" containerName="manager"
Oct 30 20:49:50.944347 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.944326    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:50.959024 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.958989    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:49:50.967893 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:50.967849    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-ad7ff0-serving-cert\""
Oct 30 20:49:51.008646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.008611    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.008815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.008698    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.008815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.008734    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9pp\" (UniqueName: \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.008815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.008790    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.072730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.072694    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:49:51.077594 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.077568    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.089188 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.089155    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ad7ff0\""
Oct 30 20:49:51.089351 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.089293    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-ad7ff0-dockercfg-8fz9v\""
Oct 30 20:49:51.091205 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.091174    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:49:51.096886 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.096857    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:49:51.097026 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.097003    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.110052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.110020    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.110303 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.110284    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.110503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.110485    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9pp\" (UniqueName: \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.110706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.110680    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.111474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.111449    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.114102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.114071    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.116813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.116776    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.118308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.118286    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:49:51.124801 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.124774    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9pp\" (UniqueName: \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\") pod \"maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.211907 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.211816    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrc5\" (UniqueName: \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.212058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.212039    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.212100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.212070    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvlm\" (UniqueName: \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.212100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.212091    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.260291 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.260255    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:51.312976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.312934    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.313207 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.312989    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvlm\" (UniqueName: \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.314187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.314163    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.314674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.314583    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.314674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.314660    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrc5\" (UniqueName: \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.315785 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.315540    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.333610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.333578    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvlm\" (UniqueName: \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\") pod \"payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.334184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.334136    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrc5\" (UniqueName: \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\") pod \"payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.401389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.401348    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:51.413518 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.413489    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:51.558602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.558573    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:49:51.561003 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:51.560974    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d3843_5750_4675_aa3d_0a4a673fe053.slice/crio-14621f3ad72c0511c636fb39b8971f865f65928d2e4e754508b6725001032f32 WatchSource:0}: Error finding container 14621f3ad72c0511c636fb39b8971f865f65928d2e4e754508b6725001032f32: Status 404 returned error can't find the container with id 14621f3ad72c0511c636fb39b8971f865f65928d2e4e754508b6725001032f32
Oct 30 20:49:51.566115 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.566095    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:49:51.690308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.690268    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:49:51.691478 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:51.691448    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caade46_7205_4e71_976e_444d0d394630.slice/crio-210c8740725dc6ad4b8ba356c38e7a3d2a1e08ce321707e61b058658ae2bf40a WatchSource:0}: Error finding container 210c8740725dc6ad4b8ba356c38e7a3d2a1e08ce321707e61b058658ae2bf40a: Status 404 returned error can't find the container with id 210c8740725dc6ad4b8ba356c38e7a3d2a1e08ce321707e61b058658ae2bf40a
Oct 30 20:49:51.725853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.725829    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:49:51.736807 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:51.736772    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3a82a7_d1c7_40e1_8978_fd81253fc35e.slice/crio-301f94574e0daec8873d7e6abfbd9b61c01e552465178dc9090dffda5a342628 WatchSource:0}: Error finding container 301f94574e0daec8873d7e6abfbd9b61c01e552465178dc9090dffda5a342628: Status 404 returned error can't find the container with id 301f94574e0daec8873d7e6abfbd9b61c01e552465178dc9090dffda5a342628
Oct 30 20:49:51.781645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.781621    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:49:51.785671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.785649    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:51.795163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.795133    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-db534b\""
Oct 30 20:49:51.795271 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.795199    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-db534b-dockercfg-9vldk\""
Oct 30 20:49:51.800448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.800422    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:49:51.831516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.831486    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:49:51.835336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.835314    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:51.846975 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.846945    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:49:51.920484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.920445    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:51.920696 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.920501    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:51.920696 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.920674    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7889j\" (UniqueName: \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:51.920809 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:51.920772    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6vn\" (UniqueName: \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.021725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.021697    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6vn\" (UniqueName: \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.022152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.021762    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.022152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.021802    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:52.022152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.021878    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7889j\" (UniqueName: \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:52.022885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.022861    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.022970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.022881    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:52.033514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.033488    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7889j\" (UniqueName: \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\") pod \"payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:52.033678 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.033659    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6vn\" (UniqueName: \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\") pod \"payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.088830 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.088794    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" event={"ID":"7caade46-7205-4e71-976e-444d0d394630","Type":"ContainerStarted","Data":"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"}
Oct 30 20:49:52.089105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.088876    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" event={"ID":"7caade46-7205-4e71-976e-444d0d394630","Type":"ContainerStarted","Data":"210c8740725dc6ad4b8ba356c38e7a3d2a1e08ce321707e61b058658ae2bf40a"}
Oct 30 20:49:52.089105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.089095    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:49:52.091048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.091020    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" event={"ID":"3f3a82a7-d1c7-40e1-8978-fd81253fc35e","Type":"ContainerStarted","Data":"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"}
Oct 30 20:49:52.091169 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.091062    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" event={"ID":"3f3a82a7-d1c7-40e1-8978-fd81253fc35e","Type":"ContainerStarted","Data":"301f94574e0daec8873d7e6abfbd9b61c01e552465178dc9090dffda5a342628"}
Oct 30 20:49:52.091169 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.091157    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:49:52.092701 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.092677    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" event={"ID":"a08d3843-5750-4675-aa3d-0a4a673fe053","Type":"ContainerStarted","Data":"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"}
Oct 30 20:49:52.092780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.092722    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" event={"ID":"a08d3843-5750-4675-aa3d-0a4a673fe053","Type":"ContainerStarted","Data":"14621f3ad72c0511c636fb39b8971f865f65928d2e4e754508b6725001032f32"}
Oct 30 20:49:52.092829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.092798    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:52.100767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.100745    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:52.119012 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.118956    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" podStartSLOduration=1.118941509 podStartE2EDuration="1.118941509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:52.115982912 +0000 UTC m=+653.919877693" watchObservedRunningTime="2026-10-30 20:49:52.118941509 +0000 UTC m=+653.922836265"
Oct 30 20:49:52.139569 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.139048    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" podStartSLOduration=1.7002795339999999 podStartE2EDuration="2.139026243s" totalImagesPullingTime="438.746709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:52.136995651 +0000 UTC m=+653.940890445" watchObservedRunningTime="2026-10-30 20:49:52.139026243 +0000 UTC m=+653.942921000"
Oct 30 20:49:52.153149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.153114    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:52.163124 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.161739    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" podStartSLOduration=1.161717607 podStartE2EDuration="1.161717607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:52.155860985 +0000 UTC m=+653.959755775" watchObservedRunningTime="2026-10-30 20:49:52.161717607 +0000 UTC m=+653.965612366"
Oct 30 20:49:52.392748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.392713    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:49:52.393718 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:52.393683    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2019cffa_9c92_4693_8a2e_377519a1aca0.slice/crio-fe9e6704c723a3f95d3ccd378e99443efaed5ec059249c24c19c921b102cd7a8 WatchSource:0}: Error finding container fe9e6704c723a3f95d3ccd378e99443efaed5ec059249c24c19c921b102cd7a8: Status 404 returned error can't find the container with id fe9e6704c723a3f95d3ccd378e99443efaed5ec059249c24c19c921b102cd7a8
Oct 30 20:49:52.447756 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.447725    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:49:52.454036 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:52.453991    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716d5e83_5a2d_407c_bdca_2bce1950de32.slice/crio-0483e05598e645a18a9094b783f13684655b223fba298952fcf4feb046713ad1 WatchSource:0}: Error finding container 0483e05598e645a18a9094b783f13684655b223fba298952fcf4feb046713ad1: Status 404 returned error can't find the container with id 0483e05598e645a18a9094b783f13684655b223fba298952fcf4feb046713ad1
Oct 30 20:49:52.616219 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.616180    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 20:49:52.620273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.620249    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.628632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.628590    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-b8aee1-dockercfg-46r9d\""
Oct 30 20:49:52.634363 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.634337    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 20:49:52.665214 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.665136    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 20:49:52.669112 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.669091    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.680108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.680081    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 20:49:52.694725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.694697    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-b8aee1\""
Oct 30 20:49:52.735032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.734810    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.735032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.734926    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkjg\" (UniqueName: \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.735032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.735002    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.735346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.735158    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h95vt\" (UniqueName: \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.841616 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.841572    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.841788 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.841647    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkjg\" (UniqueName: \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.841788 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.841709    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.841905 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.841821    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h95vt\" (UniqueName: \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.842511 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.842483    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.843200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.843177    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.854432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.854391    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h95vt\" (UniqueName: \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\") pod \"payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.861370 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.861338    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkjg\" (UniqueName: \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\") pod \"payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:52.922198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.922103    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:49:52.926742 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.926710    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:52.935053 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.935023    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:49:52.937021 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.936990    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-14cca2\""
Oct 30 20:49:52.939735 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.939711    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:52.940094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.940069    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:52.942449 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.942420    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:49:52.955641 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.952697    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:49:52.984672 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:52.984638    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:53.046034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.045998    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7j2\" (UniqueName: \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.046498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.046102    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.046498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.046180    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvqs\" (UniqueName: \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.046498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.046221    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.104671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.104486    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" event={"ID":"2019cffa-9c92-4693-8a2e-377519a1aca0","Type":"ContainerStarted","Data":"37312ab56f9c3cdee012d48a0d30bc2f0983f0eccd869b5fbc42bd67f7b1ccee"}
Oct 30 20:49:53.104671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.104593    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" event={"ID":"2019cffa-9c92-4693-8a2e-377519a1aca0","Type":"ContainerStarted","Data":"fe9e6704c723a3f95d3ccd378e99443efaed5ec059249c24c19c921b102cd7a8"}
Oct 30 20:49:53.104671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.104636    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:49:53.107462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.107430    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" event={"ID":"716d5e83-5a2d-407c-bdca-2bce1950de32","Type":"ContainerStarted","Data":"58e1ea50f1740701f741f779368c9d1fb25566f8e3778ab24665ac1668866d6d"}
Oct 30 20:49:53.107640 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.107619    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:49:53.107706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.107655    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" event={"ID":"716d5e83-5a2d-407c-bdca-2bce1950de32","Type":"ContainerStarted","Data":"0483e05598e645a18a9094b783f13684655b223fba298952fcf4feb046713ad1"}
Oct 30 20:49:53.145352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.145285    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" podStartSLOduration=2.145263096 podStartE2EDuration="2.145263096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:53.142132003 +0000 UTC m=+654.946026784" watchObservedRunningTime="2026-10-30 20:49:53.145263096 +0000 UTC m=+654.949157853"
Oct 30 20:49:53.146902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.146854    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" podStartSLOduration=2.146838539 podStartE2EDuration="2.146838539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:53.124064754 +0000 UTC m=+654.927959531" watchObservedRunningTime="2026-10-30 20:49:53.146838539 +0000 UTC m=+654.950733298"
Oct 30 20:49:53.147299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.147274    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.147386 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.147351    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvqs\" (UniqueName: \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.147600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.147389    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.147600 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.147484    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7j2\" (UniqueName: \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.148463 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.148436    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.148580 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.148445    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.160446 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.160413    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7j2\" (UniqueName: \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\") pod \"payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.160626 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.160582    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvqs\" (UniqueName: \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\") pod \"payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.235503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.235472    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 20:49:53.237811 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:53.237770    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873c7a86_ec41_43d3_b2db_8789ca4de288.slice/crio-d377f8d954fa54e568b4c764d306af4e4bbc1a867af25879d2710d5f5c43fa6e WatchSource:0}: Error finding container d377f8d954fa54e568b4c764d306af4e4bbc1a867af25879d2710d5f5c43fa6e: Status 404 returned error can't find the container with id d377f8d954fa54e568b4c764d306af4e4bbc1a867af25879d2710d5f5c43fa6e
Oct 30 20:49:53.247550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.247501    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:53.271411 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.271326    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:53.296536 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.296494    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 20:49:53.301244 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:53.301217    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03826521_fb34_4e9b_ab13_bde04b1beb29.slice/crio-0898b8e226117d25525e8656d71ddfe1255cdbd911f29b5f2599fdc29fc7c77d WatchSource:0}: Error finding container 0898b8e226117d25525e8656d71ddfe1255cdbd911f29b5f2599fdc29fc7c77d: Status 404 returned error can't find the container with id 0898b8e226117d25525e8656d71ddfe1255cdbd911f29b5f2599fdc29fc7c77d
Oct 30 20:49:53.605579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.605545    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:49:53.606711 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:53.606680    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651a897a_5eea_4634_9154_daf3587636ef.slice/crio-8a6c511acbf8597cbb12996cd7881ad5e48e0e19e04d05a2e92b23282b7567c0 WatchSource:0}: Error finding container 8a6c511acbf8597cbb12996cd7881ad5e48e0e19e04d05a2e92b23282b7567c0: Status 404 returned error can't find the container with id 8a6c511acbf8597cbb12996cd7881ad5e48e0e19e04d05a2e92b23282b7567c0
Oct 30 20:49:53.679623 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:53.679595    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:49:53.681029 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:53.681005    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de48d20_0a7b_46b9_ba54_2f0563a6b5ad.slice/crio-43e802e460d7150637ada08a22a8f9147b17cb1861bdfc24d4b82f2e92553e52 WatchSource:0}: Error finding container 43e802e460d7150637ada08a22a8f9147b17cb1861bdfc24d4b82f2e92553e52: Status 404 returned error can't find the container with id 43e802e460d7150637ada08a22a8f9147b17cb1861bdfc24d4b82f2e92553e52
Oct 30 20:49:54.119066 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.119012    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" event={"ID":"03826521-fb34-4e9b-ab13-bde04b1beb29","Type":"ContainerStarted","Data":"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"}
Oct 30 20:49:54.119834 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.119075    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" event={"ID":"03826521-fb34-4e9b-ab13-bde04b1beb29","Type":"ContainerStarted","Data":"0898b8e226117d25525e8656d71ddfe1255cdbd911f29b5f2599fdc29fc7c77d"}
Oct 30 20:49:54.120926 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.120900    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:49:54.122940 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.122912    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" event={"ID":"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad","Type":"ContainerStarted","Data":"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"}
Oct 30 20:49:54.123044 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.122963    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" event={"ID":"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad","Type":"ContainerStarted","Data":"43e802e460d7150637ada08a22a8f9147b17cb1861bdfc24d4b82f2e92553e52"}
Oct 30 20:49:54.123534 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.123501    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:49:54.125091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.125068    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" event={"ID":"651a897a-5eea-4634-9154-daf3587636ef","Type":"ContainerStarted","Data":"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"}
Oct 30 20:49:54.125209 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.125111    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" event={"ID":"651a897a-5eea-4634-9154-daf3587636ef","Type":"ContainerStarted","Data":"8a6c511acbf8597cbb12996cd7881ad5e48e0e19e04d05a2e92b23282b7567c0"}
Oct 30 20:49:54.125618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.125601    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:49:54.130364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.130332    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" event={"ID":"873c7a86-ec41-43d3-b2db-8789ca4de288","Type":"ContainerStarted","Data":"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"}
Oct 30 20:49:54.130486 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.130392    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:49:54.130486 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.130419    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" event={"ID":"873c7a86-ec41-43d3-b2db-8789ca4de288","Type":"ContainerStarted","Data":"d377f8d954fa54e568b4c764d306af4e4bbc1a867af25879d2710d5f5c43fa6e"}
Oct 30 20:49:54.160562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.157039    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" podStartSLOduration=2.157019836 podStartE2EDuration="2.157019836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:54.153752685 +0000 UTC m=+655.957647444" watchObservedRunningTime="2026-10-30 20:49:54.157019836 +0000 UTC m=+655.960914594"
Oct 30 20:49:54.161543 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.161505    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:49:54.165656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.165635    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.180969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.180945    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-14cca2-serving-cert\""
Oct 30 20:49:54.193904 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.193873    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:49:54.238604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.238539    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" podStartSLOduration=2.23850815 podStartE2EDuration="2.23850815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:54.234891074 +0000 UTC m=+656.038785855" watchObservedRunningTime="2026-10-30 20:49:54.23850815 +0000 UTC m=+656.042402905"
Oct 30 20:49:54.264048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.264000    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.264233 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.264079    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.264308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.264263    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2q6\" (UniqueName: \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.264308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.264298    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.297750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.297694    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" podStartSLOduration=2.297679722 podStartE2EDuration="2.297679722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:54.294380378 +0000 UTC m=+656.098275171" watchObservedRunningTime="2026-10-30 20:49:54.297679722 +0000 UTC m=+656.101574478"
Oct 30 20:49:54.337285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.337225    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" podStartSLOduration=2.337210753 podStartE2EDuration="2.337210753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:54.335378352 +0000 UTC m=+656.139273138" watchObservedRunningTime="2026-10-30 20:49:54.337210753 +0000 UTC m=+656.141105509"
Oct 30 20:49:54.365361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.365330    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2q6\" (UniqueName: \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.365586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.365374    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.365586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.365456    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.365586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.365503    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.365724 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:49:54.365671    5115 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-serving-cert: secret "maas-api-e2e-worker-w5-14cca2-serving-cert" not found
Oct 30 20:49:54.365776 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:49:54.365727    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls podName:90b0fbc0-47f7-4645-96e9-8705b279e7eb nodeName:}" failed. No retries permitted until 2026-10-30 20:49:54.865709183 +0000 UTC m=+656.669603918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls") pod "maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" (UID: "90b0fbc0-47f7-4645-96e9-8705b279e7eb") : secret "maas-api-e2e-worker-w5-14cca2-serving-cert" not found
Oct 30 20:49:54.366223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.366197    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.368510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.368456    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.379882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.379813    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2q6\" (UniqueName: \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.871439 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.871402    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:54.873912 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:54.873884    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") pod \"maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:55.080431 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.080390    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:55.135594 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.131169    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:49:55.144562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.137370    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.151821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.150876    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-db534b-serving-cert\""
Oct 30 20:49:55.162604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.161152    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:49:55.277233 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.277191    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.277442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.277263    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.277442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.277340    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.277669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.277637    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smv69\" (UniqueName: \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.378976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.378934    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.379176 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.378995    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.379176 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.379024    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.379176 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.379060    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smv69\" (UniqueName: \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.379751 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.379723    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.381599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.381575    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.381723 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.381695    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.403026 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.402955    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smv69\" (UniqueName: \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\") pod \"maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.409202 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.409178    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:49:55.411359 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:55.411331    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b0fbc0_47f7_4645_96e9_8705b279e7eb.slice/crio-584537b2a0d4b1978309fb026b01dd05eeef03c47c37eef032a324f0b1f54f1c WatchSource:0}: Error finding container 584537b2a0d4b1978309fb026b01dd05eeef03c47c37eef032a324f0b1f54f1c: Status 404 returned error can't find the container with id 584537b2a0d4b1978309fb026b01dd05eeef03c47c37eef032a324f0b1f54f1c
Oct 30 20:49:55.479310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.479268    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:55.765885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:55.765850    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:49:55.767221 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:55.767194    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45800fe_d3ee_4d5a_b416_3b689e6cc8f4.slice/crio-035843bc4749e2c7f2dc5dc340272a4bd1b8891504bed16d05d3eb0ded5abdbe WatchSource:0}: Error finding container 035843bc4749e2c7f2dc5dc340272a4bd1b8891504bed16d05d3eb0ded5abdbe: Status 404 returned error can't find the container with id 035843bc4749e2c7f2dc5dc340272a4bd1b8891504bed16d05d3eb0ded5abdbe
Oct 30 20:49:56.154927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.154886    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" event={"ID":"90b0fbc0-47f7-4645-96e9-8705b279e7eb","Type":"ContainerStarted","Data":"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"}
Oct 30 20:49:56.155374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.154957    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:49:56.155374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.154981    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" event={"ID":"90b0fbc0-47f7-4645-96e9-8705b279e7eb","Type":"ContainerStarted","Data":"584537b2a0d4b1978309fb026b01dd05eeef03c47c37eef032a324f0b1f54f1c"}
Oct 30 20:49:56.156326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.156293    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" event={"ID":"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4","Type":"ContainerStarted","Data":"035843bc4749e2c7f2dc5dc340272a4bd1b8891504bed16d05d3eb0ded5abdbe"}
Oct 30 20:49:56.178023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.177980    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" podStartSLOduration=1.7531024099999999 podStartE2EDuration="2.177966771s" totalImagesPullingTime="424.864361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:56.17678138 +0000 UTC m=+657.980676154" watchObservedRunningTime="2026-10-30 20:49:56.177966771 +0000 UTC m=+657.981861527"
Oct 30 20:49:56.220715 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.220680    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 20:49:56.226256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.226227    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.236438 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.236382    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-b8aee1-serving-cert\""
Oct 30 20:49:56.256569 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.255415    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 20:49:56.387671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.387636    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdrc\" (UniqueName: \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.387835 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.387789    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.387880 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.387860    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.387915 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.387894    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.489454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.489357    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.489454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.489404    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.489716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.489513    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdrc\" (UniqueName: \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.489716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.489669    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.490271 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.490242    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.492295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.492270    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.492418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.492393    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.501200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.501169    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdrc\" (UniqueName: \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\") pod \"maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.567713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.567680    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:49:56.852260 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:56.852227    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 20:49:56.854415 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:49:56.854384    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279b438d_f6b0_4b2a_8ac8_d0fe1490c313.slice/crio-173067bfb716908a308088e3f8f3f451137813fd922f57cc15c6d472b8575017 WatchSource:0}: Error finding container 173067bfb716908a308088e3f8f3f451137813fd922f57cc15c6d472b8575017: Status 404 returned error can't find the container with id 173067bfb716908a308088e3f8f3f451137813fd922f57cc15c6d472b8575017
Oct 30 20:49:57.165334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:57.165233    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" event={"ID":"279b438d-f6b0-4b2a-8ac8-d0fe1490c313","Type":"ContainerStarted","Data":"173067bfb716908a308088e3f8f3f451137813fd922f57cc15c6d472b8575017"}
Oct 30 20:49:57.167301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:57.167264    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" event={"ID":"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4","Type":"ContainerStarted","Data":"e8f5f2b64030701fabb46deb06db7149fbe27953d60ae5c5f04b83b17622e305"}
Oct 30 20:49:57.190481 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:57.190411    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" podStartSLOduration=1.8003093159999999 podStartE2EDuration="2.190368939s" totalImagesPullingTime="390.059623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:57.187160044 +0000 UTC m=+658.991054813" watchObservedRunningTime="2026-10-30 20:49:57.190368939 +0000 UTC m=+658.994263696"
Oct 30 20:49:58.113714 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:58.113678    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:49:58.176203 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:58.176164    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" event={"ID":"279b438d-f6b0-4b2a-8ac8-d0fe1490c313","Type":"ContainerStarted","Data":"d02d63fbe4a8fa3946979e36bd877cda86cece7d7119281af843328a3ace2508"}
Oct 30 20:49:58.176768 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:58.176744    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:49:58.202401 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:58.202329    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" podStartSLOduration=1.72563161 podStartE2EDuration="2.202307235s" totalImagesPullingTime="476.675625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:58.198376052 +0000 UTC m=+660.002270827" watchObservedRunningTime="2026-10-30 20:49:58.202307235 +0000 UTC m=+660.006201992"
Oct 30 20:49:59.183127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:49:59.183096    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:50:02.174684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:02.173911    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:50:03.110456 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.110425    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:50:03.110669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.110512    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:50:03.540507 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.540470    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:50:03.547383 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.547344    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.556646 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.556607    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-cb60a2\""
Oct 30 20:50:03.556858 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.556808    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-cb60a2-dockercfg-98zzk\""
Oct 30 20:50:03.557151 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.557123    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:50:03.576417 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.576389    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:50:03.581442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.581418    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.596250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.596223    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:50:03.674267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.674223    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.674753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.674722    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk78s\" (UniqueName: \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.777253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.777214    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4nhj\" (UniqueName: \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.777475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.777267    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.777475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.777420    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.777475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.777468    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk78s\" (UniqueName: \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.778274 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.778256    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.793538 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.793452    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk78s\" (UniqueName: \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\") pod \"payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.866712 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.866671    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:03.878779 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.878746    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4nhj\" (UniqueName: \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.878929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.878806    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.879672 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.879647    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.890876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.890849    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4nhj\" (UniqueName: \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\") pod \"payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:03.898720 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:03.898687    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:04.132773 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.132701    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:50:04.149704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.149679    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:50:04.151005 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:50:04.150975    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093c40d9_68c1_4f4f_b787_542ceba1a0e4.slice/crio-e415ad987e6cd25ac962cf50b9711448a845f82b2d8dbb78f47f0da5c341235c WatchSource:0}: Error finding container e415ad987e6cd25ac962cf50b9711448a845f82b2d8dbb78f47f0da5c341235c: Status 404 returned error can't find the container with id e415ad987e6cd25ac962cf50b9711448a845f82b2d8dbb78f47f0da5c341235c
Oct 30 20:50:04.189515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.189492    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:50:04.195889 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.195860    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:50:04.197659 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:50:04.197633    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2ce495_e87a_4832_b25b_e6839444a1d6.slice/crio-0ee2bff12d1a329a10b08bf40f8c052293afddd5d6a270124dfe6ef9c67e40a8 WatchSource:0}: Error finding container 0ee2bff12d1a329a10b08bf40f8c052293afddd5d6a270124dfe6ef9c67e40a8: Status 404 returned error can't find the container with id 0ee2bff12d1a329a10b08bf40f8c052293afddd5d6a270124dfe6ef9c67e40a8
Oct 30 20:50:04.218762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.218733    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" event={"ID":"093c40d9-68c1-4f4f-b787-542ceba1a0e4","Type":"ContainerStarted","Data":"e415ad987e6cd25ac962cf50b9711448a845f82b2d8dbb78f47f0da5c341235c"}
Oct 30 20:50:04.233820 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:04.233786    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" event={"ID":"ba2ce495-e87a-4832-b25b-e6839444a1d6","Type":"ContainerStarted","Data":"0ee2bff12d1a329a10b08bf40f8c052293afddd5d6a270124dfe6ef9c67e40a8"}
Oct 30 20:50:05.151937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.151909    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:50:05.152335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.151971    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 20:50:05.195113 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.195082    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 20:50:05.245055 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.245013    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" event={"ID":"093c40d9-68c1-4f4f-b787-542ceba1a0e4","Type":"ContainerStarted","Data":"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"}
Oct 30 20:50:05.245259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.245093    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:05.247306 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.247271    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" event={"ID":"ba2ce495-e87a-4832-b25b-e6839444a1d6","Type":"ContainerStarted","Data":"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"}
Oct 30 20:50:05.247426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.247329    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:05.292269 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.292161    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" podStartSLOduration=2.292122663 podStartE2EDuration="2.292122663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:05.287464281 +0000 UTC m=+667.091359056" watchObservedRunningTime="2026-10-30 20:50:05.292122663 +0000 UTC m=+667.096017420"
Oct 30 20:50:05.324469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:05.324419    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" podStartSLOduration=2.324405545 podStartE2EDuration="2.324405545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:05.322794137 +0000 UTC m=+667.126688918" watchObservedRunningTime="2026-10-30 20:50:05.324405545 +0000 UTC m=+667.128300298"
Oct 30 20:50:06.159986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.159854    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 20:50:06.160383 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.160143    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:50:06.160383 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.160195    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:50:06.284516 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:50:06.284475    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:50:06.796066 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.796036    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 20:50:06.800251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.800234    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.803295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.803274    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-3d909d-serving-cert\""
Oct 30 20:50:06.808060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.807832    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.808060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.807977    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.808060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.808047    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.808241 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.808153    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586nb\" (UniqueName: \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.815780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.815753    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 20:50:06.909002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.908970    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586nb\" (UniqueName: \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.909196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.909068    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.909196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.909134    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.909196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.909160    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.909377 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:50:06.909209    5115 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-serving-cert: secret "maas-api-e2e-worker-w6-3d909d-serving-cert" not found
Oct 30 20:50:06.909377 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:50:06.909296    5115 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls podName:5b39ef8e-59aa-44e1-9268-f035458aaf62 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:07.409272862 +0000 UTC m=+669.213167613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls") pod "maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" (UID: "5b39ef8e-59aa-44e1-9268-f035458aaf62") : secret "maas-api-e2e-worker-w6-3d909d-serving-cert" not found
Oct 30 20:50:06.910536 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.910494    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.911957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.911933    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:06.923859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:06.923832    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586nb\" (UniqueName: \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:07.414201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:07.414157    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:07.416748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:07.416718    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:07.714505 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:07.714416    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:08.001607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:08.001580    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 20:50:08.004502 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:50:08.004460    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b39ef8e_59aa_44e1_9268_f035458aaf62.slice/crio-9bff54cf12023e96067b12fcf30fb1075414a6da5c9a1380baf803db8a1a8939 WatchSource:0}: Error finding container 9bff54cf12023e96067b12fcf30fb1075414a6da5c9a1380baf803db8a1a8939: Status 404 returned error can't find the container with id 9bff54cf12023e96067b12fcf30fb1075414a6da5c9a1380baf803db8a1a8939
Oct 30 20:50:08.274305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:08.274273    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" event={"ID":"5b39ef8e-59aa-44e1-9268-f035458aaf62","Type":"ContainerStarted","Data":"9bff54cf12023e96067b12fcf30fb1075414a6da5c9a1380baf803db8a1a8939"}
Oct 30 20:50:09.282265 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:09.282228    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" event={"ID":"5b39ef8e-59aa-44e1-9268-f035458aaf62","Type":"ContainerStarted","Data":"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"}
Oct 30 20:50:09.282687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:09.282317    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:09.305810 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:09.305746    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" podStartSLOduration=2.803973741 podStartE2EDuration="3.305728476s" totalImagesPullingTime="501.754735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:09.304163584 +0000 UTC m=+671.108058363" watchObservedRunningTime="2026-10-30 20:50:09.305728476 +0000 UTC m=+671.109623236"
Oct 30 20:50:15.294611 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:15.294579    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:50:16.263800 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:16.263767    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:50:16.263973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:50:16.263850    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:50:36.278630 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:50:36.278594    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:51:06.279749 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:51:06.279716    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:51:08.385920 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.385891    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 20:51:08.391643 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.391612    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.399249 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.399224    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f2ed1e\"/\"openshift-service-ca.crt\""
Oct 30 20:51:08.399815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.399795    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f2ed1e\"/\"default-dockercfg-2nmmh\""
Oct 30 20:51:08.399815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.399801    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f2ed1e\"/\"kube-root-ca.crt\""
Oct 30 20:51:08.400029 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.399833    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f2ed1e\"/\"premium-w4-f2ed1e-kserve-self-signed-certs\""
Oct 30 20:51:08.400296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.400272    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 20:51:08.545727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545693    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.545903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545740    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.545903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545774    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w4zs\" (UniqueName: \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.545903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545871    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.545903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545898    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.546048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.545919    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647152    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647211    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647240    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w4zs\" (UniqueName: \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647275    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647294    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647431    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647775    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.647947 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.647880    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.648086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.648066    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.649413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.649390    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.649907 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.649890    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.658780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.658755    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w4zs\" (UniqueName: \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\") pod \"premium-w4-f2ed1e-kserve-58f659c6c-5r5dp\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") " pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.708435 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.708405    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:08.995564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:08.995534    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 20:51:08.997249 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:51:08.997221    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f296a7d_85a6_420f_a88a_8f818293e54d.slice/crio-42b19ff7b6e4dc169e9bef4700d6af5dc20321e117edf5d7e2d2789a3ab51979 WatchSource:0}: Error finding container 42b19ff7b6e4dc169e9bef4700d6af5dc20321e117edf5d7e2d2789a3ab51979: Status 404 returned error can't find the container with id 42b19ff7b6e4dc169e9bef4700d6af5dc20321e117edf5d7e2d2789a3ab51979
Oct 30 20:51:09.682566 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:09.682507    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" event={"ID":"1f296a7d-85a6-420f-a88a-8f818293e54d","Type":"ContainerStarted","Data":"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"}
Oct 30 20:51:09.682958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:09.682580    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" event={"ID":"1f296a7d-85a6-420f-a88a-8f818293e54d","Type":"ContainerStarted","Data":"42b19ff7b6e4dc169e9bef4700d6af5dc20321e117edf5d7e2d2789a3ab51979"}
Oct 30 20:51:09.699977 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:09.699925    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podStartSLOduration=1.699908605 podStartE2EDuration="1.699908605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:09.699501083 +0000 UTC m=+731.503395840" watchObservedRunningTime="2026-10-30 20:51:09.699908605 +0000 UTC m=+731.503803394"
Oct 30 20:51:09.708557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:09.708519    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:18.709494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:18.709460    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:18.722970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:18.722940    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:18.755372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:18.755338    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:51:31.840913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.840875    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:51:31.845322 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.845299    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.856618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.856584    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-14cca2-openshift-default-dockercfg-559j6\""
Oct 30 20:51:31.859709 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.859681    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:51:31.899917 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.899886    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.899917 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.899918    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.899970    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900044    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900071    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900337 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900189    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900337 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900232    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900337 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900311    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:31.900468 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:31.900349    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz8f\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001169    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001202    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001243    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001259    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001281    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001305    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz8f\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001377    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001392    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001452 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001442    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001756    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001840    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.001878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001864    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.002032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.001958    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.002230 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.002210    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.003626 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.003604    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.003939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.003916    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.012962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.012935    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.013053 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.013007    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz8f\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.161989 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.161916    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:32.452226 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.452196    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:51:32.453911 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:51:32.453876    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bb2791_9cc4_4ad5_8116_76bac4ad8b02.slice/crio-3d423299c89276c1714c501c79888d0acb5d76f3271b1ef7b85f96fcf8aa1d18 WatchSource:0}: Error finding container 3d423299c89276c1714c501c79888d0acb5d76f3271b1ef7b85f96fcf8aa1d18: Status 404 returned error can't find the container with id 3d423299c89276c1714c501c79888d0acb5d76f3271b1ef7b85f96fcf8aa1d18
Oct 30 20:51:32.456387 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.456354    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:51:32.456473 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.456432    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:51:32.456473 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.456464    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:51:32.840863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.840817    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" event={"ID":"70bb2791-9cc4-4ad5-8116-76bac4ad8b02","Type":"ContainerStarted","Data":"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"}
Oct 30 20:51:32.841058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.840882    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" event={"ID":"70bb2791-9cc4-4ad5-8116-76bac4ad8b02","Type":"ContainerStarted","Data":"3d423299c89276c1714c501c79888d0acb5d76f3271b1ef7b85f96fcf8aa1d18"}
Oct 30 20:51:32.863904 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:32.863843    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podStartSLOduration=1.8638248210000001 podStartE2EDuration="1.863824821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:32.862114916 +0000 UTC m=+754.666009692" watchObservedRunningTime="2026-10-30 20:51:32.863824821 +0000 UTC m=+754.667719578"
Oct 30 20:51:33.162563 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:33.162455    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:33.163782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:33.163757    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:33.163901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:33.163806    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:34.162430 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:34.162398    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:34.162872 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:34.162463    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:35.163297 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:35.163262    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:35.163720 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:35.163322    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:36.163183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:36.163152    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:36.163360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:36.163210    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:36.279920 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:51:36.279886    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:51:37.162301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:37.162263    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:37.162497 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:37.162336    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:38.162777 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:38.162741    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:51:38.163185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:38.162803    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 20:51:39.167581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:39.167478    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:39.168079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:39.167766    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:51:39.168479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:51:39.168460    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:52:01.555336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.555299    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:52:01.559676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.559653    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.565200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.565171    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-ad7ff0-openshift-default-dockercfg-pmg7l\""
Oct 30 20:52:01.583627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.577463    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:52:01.639139 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639101    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639151    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639290    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639359    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639407    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639514    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639634 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639590    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639713    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.639783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.639742    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5nv\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741129    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741175    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741257    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741285    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5nv\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741324    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741359    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741429    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741475    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741573    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741833 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741789    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741833 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741818    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741868    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.741996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.741951    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.742157 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.742139    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.743804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.743782    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.744005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.743983    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.752610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.752584    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.752758 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.752740    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5nv\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.901755 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.901660    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:01.957865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.957831    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 20:52:01.962326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.962300    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:01.971296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.971266    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-3d909d-openshift-default-dockercfg-727tj\""
Oct 30 20:52:01.976956 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:01.976915    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 20:52:02.045750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.045707    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.045750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.045746    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046018 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.045868    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046018 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.045946    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77fg4\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046018 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.045972    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.046023    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.046055    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.046121    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.046336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.046236    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147029 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.146991    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147057    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147100    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147119    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147155    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147196    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77fg4\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147223    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147560 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147304    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147560 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147347    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147512    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147581    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147846 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147816    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147845    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.147987 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.147933    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.149390 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.149367    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.149719 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.149702    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.158943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.158873    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.159062 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.159016    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77fg4\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.200930 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.200901    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:52:02.202389 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:02.202360    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d1f441_e639_4ae2_85f8_f4556b916c4d.slice/crio-a72fd07b5de21f12df6724254db337c9ccd709cee33a0ee9df77ca9e4631c88e WatchSource:0}: Error finding container a72fd07b5de21f12df6724254db337c9ccd709cee33a0ee9df77ca9e4631c88e: Status 404 returned error can't find the container with id a72fd07b5de21f12df6724254db337c9ccd709cee33a0ee9df77ca9e4631c88e
Oct 30 20:52:02.205077 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.205040    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:02.205206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.205127    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:02.205206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.205174    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:02.296640 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.296601    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:02.593217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.593174    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 20:52:02.593888 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:02.593861    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e747449_02be_4dff_9486_665f5bc54c6d.slice/crio-eb90835fc49265db8e94459dc444de3154cdf12ac32d0c2dcdc880d69304461d WatchSource:0}: Error finding container eb90835fc49265db8e94459dc444de3154cdf12ac32d0c2dcdc880d69304461d: Status 404 returned error can't find the container with id eb90835fc49265db8e94459dc444de3154cdf12ac32d0c2dcdc880d69304461d
Oct 30 20:52:02.597109 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.597067    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:02.597222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.597152    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:02.597222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:02.597187    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:03.058163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.058122    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" event={"ID":"3e747449-02be-4dff-9486-665f5bc54c6d","Type":"ContainerStarted","Data":"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"}
Oct 30 20:52:03.058367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.058186    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" event={"ID":"3e747449-02be-4dff-9486-665f5bc54c6d","Type":"ContainerStarted","Data":"eb90835fc49265db8e94459dc444de3154cdf12ac32d0c2dcdc880d69304461d"}
Oct 30 20:52:03.059815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.059788    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" event={"ID":"03d1f441-e639-4ae2-85f8-f4556b916c4d","Type":"ContainerStarted","Data":"f1635e473455bfbaf5bb1db8c7df10e0aef67cdd262e417f5bdb3ab506f63a4b"}
Oct 30 20:52:03.059927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.059842    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" event={"ID":"03d1f441-e639-4ae2-85f8-f4556b916c4d","Type":"ContainerStarted","Data":"a72fd07b5de21f12df6724254db337c9ccd709cee33a0ee9df77ca9e4631c88e"}
Oct 30 20:52:03.080272 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.080208    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podStartSLOduration=2.080189405 podStartE2EDuration="2.080189405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:03.079076008 +0000 UTC m=+784.882970782" watchObservedRunningTime="2026-10-30 20:52:03.080189405 +0000 UTC m=+784.884084162"
Oct 30 20:52:03.100471 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.100397    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podStartSLOduration=2.100379032 podStartE2EDuration="2.100379032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:03.099120888 +0000 UTC m=+784.903015645" watchObservedRunningTime="2026-10-30 20:52:03.100379032 +0000 UTC m=+784.904273791"
Oct 30 20:52:03.297567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.297507    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:03.299145 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.299118    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:03.299280 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.299177    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:03.902837 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.902803    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:03.904262 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.904235    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:03.904388 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:03.904281    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:04.297593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:04.297557    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:04.297815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:04.297618    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:04.902453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:04.902413    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:04.902668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:04.902465    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:05.297727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:05.297693    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:05.298121 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:05.297741    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:05.902597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:05.902550    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:05.902785 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:05.902609    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:06.297765 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:06.297718    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:06.298173 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:06.297792    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:06.303405 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:52:06.303375    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:52:06.902308 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:06.902279    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:06.902589 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:06.902546    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:07.304050 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:07.304009    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:07.305008 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:07.304971    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:07.903068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:07.903027    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:07.903247 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:07.903091    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:08.298399 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:08.298362    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:08.298718 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:08.298686    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:08.902429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:08.902371    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:52:08.902860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:08.902452    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 20:52:09.297119 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:09.297084    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:52:09.297296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:09.297144    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 20:52:10.392319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.392285    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:10.392869 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.392847    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:10.394758 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.394733    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:52:10.872462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.872422    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:10.873204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.873144    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:10.889644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:10.889615    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 20:52:16.818714 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.818677    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:52:16.823342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.823314    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.826323 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.826296    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-db534b-openshift-default-dockercfg-4psrd\""
Oct 30 20:52:16.844774 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.844743    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:52:16.856405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856375    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856461    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856588    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856615    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856668    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856823    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856853    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856904    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.856969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.856960    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.957994 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.957949    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.957999    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958028    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958068    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958103    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958178    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958276    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958301    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958346    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958499    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.958905 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.958886    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.959128 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.959104    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.959204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.959138    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.959204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.959182    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.960436 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.960414    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.960969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.960946    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.969686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.969663    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:16.969845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:16.969828    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:17.139140 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:17.139046    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:17.426069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:17.426038    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:52:17.427794 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:17.427754    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1402c404_8b23_4998_afd9_51147b1116ba.slice/crio-118fea5953c1e15a05d2fd63a1f9376a4bb7523945df7d6b56acb1071b527280 WatchSource:0}: Error finding container 118fea5953c1e15a05d2fd63a1f9376a4bb7523945df7d6b56acb1071b527280: Status 404 returned error can't find the container with id 118fea5953c1e15a05d2fd63a1f9376a4bb7523945df7d6b56acb1071b527280
Oct 30 20:52:17.430675 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:17.430641    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:17.430795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:17.430713    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:17.430795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:17.430744    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:18.190584 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:18.190549    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" event={"ID":"1402c404-8b23-4998-afd9-51147b1116ba","Type":"ContainerStarted","Data":"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"}
Oct 30 20:52:18.191094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:18.190599    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" event={"ID":"1402c404-8b23-4998-afd9-51147b1116ba","Type":"ContainerStarted","Data":"118fea5953c1e15a05d2fd63a1f9376a4bb7523945df7d6b56acb1071b527280"}
Oct 30 20:52:18.216042 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:18.215987    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podStartSLOduration=2.215971112 podStartE2EDuration="2.215971112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:18.213550827 +0000 UTC m=+800.017445598" watchObservedRunningTime="2026-10-30 20:52:18.215971112 +0000 UTC m=+800.019865867"
Oct 30 20:52:19.142568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:19.141248    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:19.142568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:19.141380    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:19.142568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:19.141423    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:20.147702 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:20.147659    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:20.148206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:20.147738    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:21.146554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:21.141987    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:21.146554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:21.142068    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:22.142424 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:22.141950    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:22.142424 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:22.142029    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:23.140971 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:23.140934    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:23.141638 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:23.141603    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:24.140324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:24.140276    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:52:24.140823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:24.140373    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 20:52:25.576469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:25.576038    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:25.577194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:25.577164    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:25.578433 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:25.578410    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:52:33.876342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.876304    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:52:33.882101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.882074    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.887860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.887832    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db534b\"/\"default-dockercfg-z8rc4\""
Oct 30 20:52:33.892245 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.892221    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db534b\"/\"openshift-service-ca.crt\""
Oct 30 20:52:33.892867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.892847    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db534b\"/\"kube-root-ca.crt\""
Oct 30 20:52:33.893090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.892874    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:52:33.938232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938200    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.938232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938239    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.938494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938257    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.938494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938373    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.938628 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938511    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.938683 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.938645    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc58m\" (UniqueName: \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:33.988214 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:33.988184    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db534b\"/\"distinct-w2-db534b-kserve-self-signed-certs\""
Oct 30 20:52:34.039269 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039228    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc58m\" (UniqueName: \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039308    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039342    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039364    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039404    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039770 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039489    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039851    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039865    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.039965 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.039948    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.041821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.041797    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.041935 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.041917    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.050480 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.050449    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc58m\" (UniqueName: \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\") pod \"distinct-w2-db534b-kserve-5b65795899-7mcbq\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") " pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.197469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.197386    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:34.482304 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:34.482275    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:52:34.483290 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:34.483258    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e55395_8ed8_4393_8871_1b54a5efdc0b.slice/crio-25592ea1fd15dcfccb395cb284a24df0aae30f7bde116fef8d7cf7b2e83258ce WatchSource:0}: Error finding container 25592ea1fd15dcfccb395cb284a24df0aae30f7bde116fef8d7cf7b2e83258ce: Status 404 returned error can't find the container with id 25592ea1fd15dcfccb395cb284a24df0aae30f7bde116fef8d7cf7b2e83258ce
Oct 30 20:52:35.312950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.312915    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" event={"ID":"c5e55395-8ed8-4393-8871-1b54a5efdc0b","Type":"ContainerStarted","Data":"46d88276acca436e0bbcf76e0cc2367f1edc3b280b124ea4bd8320508d1f56ec"}
Oct 30 20:52:35.313338 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.312958    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" event={"ID":"c5e55395-8ed8-4393-8871-1b54a5efdc0b","Type":"ContainerStarted","Data":"25592ea1fd15dcfccb395cb284a24df0aae30f7bde116fef8d7cf7b2e83258ce"}
Oct 30 20:52:35.340824 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.340765    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podStartSLOduration=2.340746015 podStartE2EDuration="2.340746015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:35.339607073 +0000 UTC m=+817.143501829" watchObservedRunningTime="2026-10-30 20:52:35.340746015 +0000 UTC m=+817.144640774"
Oct 30 20:52:35.659424 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.659353    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 20:52:35.663783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.663765    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.683503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.683475    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 20:52:35.698424 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.698390    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 20:52:35.702468 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.702444    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.722277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.722250    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 20:52:35.757149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757099    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8pwq\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757137    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757158    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757264    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvnnp\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757300    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757315    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757337    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757434    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757499    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757604    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757771 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757648    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.757771 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757720    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757771 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757755    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757931 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757832    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757931 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757867    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.757931 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757906    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.758034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757938    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.758034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.757994    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859290    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8pwq\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859337    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859367    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859391    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvnnp\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859449    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859494    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859521    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859594    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859696    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859733    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859768    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859801    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859868    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.859929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859904    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.859959    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860019    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860043    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860072    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860087    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860236    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.860334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860115    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860545    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.860775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860556    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860672    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.860935 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860814    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.861028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.860997    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.861186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.861160    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.861238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.861206    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.862151 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.862124    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.862373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.862350    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.862684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.862667    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.863283 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.863265    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.871409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.871152    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvnnp\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.871565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.871498    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8pwq\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.872389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.872366    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-7cwww\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:35.872570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.872549    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\") pod \"maas-default-gateway-openshift-default-6db586dd6c-k29kh\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:35.979710 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:35.979626    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:36.026725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.026686    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:36.198062 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.198030    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:36.274882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.274850    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 20:52:36.276476 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:36.276447    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6886a61_73e6_4814_adbf_04584f946ec4.slice/crio-cae446276e9f89991aba2d83c275ea41d71b448598a28aa3f5be879ed1d2c361 WatchSource:0}: Error finding container cae446276e9f89991aba2d83c275ea41d71b448598a28aa3f5be879ed1d2c361: Status 404 returned error can't find the container with id cae446276e9f89991aba2d83c275ea41d71b448598a28aa3f5be879ed1d2c361
Oct 30 20:52:36.279699 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.279663    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:36.279804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.279749    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:36.279804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.279788    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:36.281625 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:52:36.281593    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:52:36.321157 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.321121    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" event={"ID":"b6886a61-73e6-4814-adbf-04584f946ec4","Type":"ContainerStarted","Data":"cae446276e9f89991aba2d83c275ea41d71b448598a28aa3f5be879ed1d2c361"}
Oct 30 20:52:36.341439 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.341413    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 20:52:36.345301 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:36.345259    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ebb90_da25_4937_868a_bc58f3b6ee05.slice/crio-a769a92da846d11d898a053518273792b32b365d2a51a518ef1de77ac76ad405 WatchSource:0}: Error finding container a769a92da846d11d898a053518273792b32b365d2a51a518ef1de77ac76ad405: Status 404 returned error can't find the container with id a769a92da846d11d898a053518273792b32b365d2a51a518ef1de77ac76ad405
Oct 30 20:52:36.348076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.348043    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:36.348180 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.348117    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:36.348180 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:36.348148    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:37.368549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.357480    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" event={"ID":"b06ebb90-da25-4937-868a-bc58f3b6ee05","Type":"ContainerStarted","Data":"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"}
Oct 30 20:52:37.368549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.357612    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" event={"ID":"b06ebb90-da25-4937-868a-bc58f3b6ee05","Type":"ContainerStarted","Data":"a769a92da846d11d898a053518273792b32b365d2a51a518ef1de77ac76ad405"}
Oct 30 20:52:37.368549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.364554    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" event={"ID":"b6886a61-73e6-4814-adbf-04584f946ec4","Type":"ContainerStarted","Data":"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"}
Oct 30 20:52:37.396029 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.395970    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podStartSLOduration=2.395956307 podStartE2EDuration="2.395956307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:37.393787093 +0000 UTC m=+819.197681849" watchObservedRunningTime="2026-10-30 20:52:37.395956307 +0000 UTC m=+819.199851063"
Oct 30 20:52:37.416865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.416819    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podStartSLOduration=2.416805234 podStartE2EDuration="2.416805234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:37.414341622 +0000 UTC m=+819.218236379" watchObservedRunningTime="2026-10-30 20:52:37.416805234 +0000 UTC m=+819.220699991"
Oct 30 20:52:37.979866 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.979818    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:37.981505 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.981471    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:37.981677 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:37.981588    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:38.039122 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:38.031919    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:38.039475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:38.039445    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:38.039734 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:38.039705    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:38.980732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:38.980698    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:38.981130 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:38.980764    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:39.030944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:39.030905    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:39.031218 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:39.031190    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:39.981570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:39.980204    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:39.981570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:39.980268    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:40.078484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:40.076117    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:40.078484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:40.076207    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:40.981324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:40.981271    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:40.981492 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:40.981370    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:41.048551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:41.038370    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:41.048551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:41.038446    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:41.980192 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:41.980077    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:41.980192 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:41.980161    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:42.034397 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:42.034359    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:42.034673 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:42.034645    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:42.980039 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:42.979990    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:42.980562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:42.980080    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:43.028432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:43.028392    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:43.028662 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:43.028461    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:43.980943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:43.980905    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 20:52:43.981441 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:43.980962    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 20:52:44.027985 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:44.027943    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:52:44.028202 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:44.028002    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 20:52:44.198153 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:44.198121    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:44.211579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:44.211549    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:44.454172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:44.454123    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:52:45.167108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.167056    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:45.168759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.168732    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:45.169793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.169771    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 20:52:45.341661 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.341629    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:45.342258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.342230    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:45.343091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:45.343069    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 20:52:46.370902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.370869    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 20:52:46.375272 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.375252    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.385823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.385006    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 20:52:46.385823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.385084    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-f2ed1e-openshift-default-dockercfg-g7p8g\""
Oct 30 20:52:46.456791 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.456750    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.456795    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.456915    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.456952    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rdmk\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.457161    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.457201    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.457247    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457352 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.457339    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.457447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.457423    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559014    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559058    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rdmk\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559200    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559232    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559348 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559299    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559345    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559430 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559395    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.559792 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559764    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560000 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559840    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559859    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.559983    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.560162    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.560219    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.560342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.560308    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.562633 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.562613    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.563864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.563846    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.572686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.572655    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rdmk\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.590057 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.590023    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.698326 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.698243    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:46.999712 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:46.999677    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 20:52:47.001582 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:52:47.001510    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9363a9_df6f_43a7_82c1_4c8b1ba3d4ef.slice/crio-633f59c97b3f4899fbb44483b3c66a642d1ea39a38664ec952f5b200db97cfb1 WatchSource:0}: Error finding container 633f59c97b3f4899fbb44483b3c66a642d1ea39a38664ec952f5b200db97cfb1: Status 404 returned error can't find the container with id 633f59c97b3f4899fbb44483b3c66a642d1ea39a38664ec952f5b200db97cfb1
Oct 30 20:52:47.003787 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.003741    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:47.003886 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.003829    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:47.003966 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.003885    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:47.468798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.468763    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" event={"ID":"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef","Type":"ContainerStarted","Data":"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"}
Oct 30 20:52:47.469411 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.468823    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" event={"ID":"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef","Type":"ContainerStarted","Data":"633f59c97b3f4899fbb44483b3c66a642d1ea39a38664ec952f5b200db97cfb1"}
Oct 30 20:52:47.698398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:47.698365    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:48.700995 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:48.700518    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 20:52:48.700995 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:48.700617    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 20:52:49.699121 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:49.699088    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 20:52:49.699310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:49.699143    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 20:52:50.699093 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:50.699054    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 20:52:50.699499 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:50.699152    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 20:52:51.698678 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:51.698640    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 20:52:51.698867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:51.698702    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 20:52:52.699414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:52.699377    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 20:52:52.699916 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:52.699446    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 20:52:53.705845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:53.705804    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:53.706814 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:53.706792    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:53.708036 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:53.707991    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 20:52:53.730610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:52:53.730561    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podStartSLOduration=7.730547523 podStartE2EDuration="7.730547523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:47.497828883 +0000 UTC m=+829.301723659" watchObservedRunningTime="2026-10-30 20:52:53.730547523 +0000 UTC m=+835.534442273"
Oct 30 20:53:01.065641 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.065602    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:53:01.078262 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.078221    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:53:01.078441 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.078344    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.084441 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.084414    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-14cca2\"/\"openshift-service-ca.crt\""
Oct 30 20:53:01.088091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.088066    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-14cca2\"/\"default-dockercfg-lspws\""
Oct 30 20:53:01.088216 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.088123    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-14cca2\"/\"distinct-2-w5-14cca2-kserve-self-signed-certs\""
Oct 30 20:53:01.179669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.179627    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.179858 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.179838    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59rq\" (UniqueName: \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.179902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.179874    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.179902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.179890    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.179996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.179982    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.180031 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.180018    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.186333 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.186309    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-14cca2\"/\"kube-root-ca.crt\""
Oct 30 20:53:01.281650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.281601    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.281861 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.281806    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59rq\" (UniqueName: \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.281861 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.281849    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.281981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.281873    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.281981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.281948    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.282147 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.282062    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.282221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.282202    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.282437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.282411    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.282753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.282732    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.284732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.284708    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.286934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.286915    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.303797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.303751    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59rq\" (UniqueName: \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\") pod \"distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") " pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.393027 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.392939    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:01.416913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.416882    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 20:53:01.422878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.422851    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.434253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.434208    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 20:53:01.484190 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484149    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484345 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484239    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484345 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484283    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484607    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484751 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484733    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484831    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdlp\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484919 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484903    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.484960 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484942    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.485010 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.484992    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.586728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586695    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.586945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586789    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.586945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586847    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdlp\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.586945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586890    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.586945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586920    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.586966    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587034    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587278 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587184    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587278 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587220    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587381 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587318    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587415    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587506 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587480    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.587716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.587681    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.588076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.588051    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.589341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.589317    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.589470 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.589451    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.599573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.599542    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdlp\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.599732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.599716    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.676183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.676096    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:53:01.681647 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.681610    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.703318 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.703291    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:53:01.709873 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.709470    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:53:01.744331 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.744298    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 20:53:01.751187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.751156    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.756944 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.756919    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-b8aee1-openshift-default-dockercfg-trpph\""
Oct 30 20:53:01.762346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.762312    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 20:53:01.766017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.765992    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:01.790393 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.790355    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.790573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.790458    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.790573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.790537    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.790686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.790580    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.792374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.792322    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpxj\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.792454 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.792379    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.792514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.792451    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.792514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.792479    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.792627 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.792565    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.793473 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793449    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793510    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793567    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793606    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.793693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793635    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793667    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.793795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793690    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793719    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.793795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.793746    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lx8j\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894722    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894787    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894823    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpxj\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894855    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894922    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.894950    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895012    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895036    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895078    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895119    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895153    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895359    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895432    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895155    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895580    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895622    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895648    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895680    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895705    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lx8j\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895757    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895817    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.895996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.895853    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.897298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.896259    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.897298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.896563    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.897298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.896739    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.897298 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.896960    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.897507 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.897366    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.897632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.897595    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.899027 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.898978    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.901708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.901641    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.901875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.901848    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.902458 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.902424    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.911174 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.908476    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.913821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.911964    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.913821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.912492    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpxj\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:01.914101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.913833    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lx8j\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:01.999980 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:01.999886    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:02.112972 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.112928    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 20:53:02.114547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.114457    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:02.117234 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:02.117204    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc03e853_e381_4d38_a47b_2ee6c6e6cb43.slice/crio-def510819ab33c7a5b2dddf406709e1a07990dbed943d680c1832414a7b07f47 WatchSource:0}: Error finding container def510819ab33c7a5b2dddf406709e1a07990dbed943d680c1832414a7b07f47: Status 404 returned error can't find the container with id def510819ab33c7a5b2dddf406709e1a07990dbed943d680c1832414a7b07f47
Oct 30 20:53:02.120039 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.119958    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.120039 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.120024    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.120196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.120075    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.251632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.251549    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:53:02.257220 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.257191    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.267091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.267061    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-cb60a2-openshift-default-dockercfg-zl72q\""
Oct 30 20:53:02.273741 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.273507    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:53:02.301142 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301105    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301399    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301455    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301608    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301659    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhfdd\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301701    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301738    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301804    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.302056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.301829    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.312567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.312003    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.312567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.312087    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.312567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.312133    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.314681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.313723    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:53:02.402959 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.402931    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403089 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.402979    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhfdd\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403089 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403013    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403089 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403035    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403189 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403100    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403189 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403123    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403312 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403293    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403451 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403423    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403645 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403561    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403837    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.403967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.403888    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.404794 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.404163    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.404794 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.404274    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.404794 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.404291    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.406557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.406327    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.406654 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.406632    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.417264 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.417239    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.417404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.417387    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhfdd\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.427053 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.426996    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 20:53:02.427802 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:02.427778    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d01618_f816_421d_9cbd_7d73db71c606.slice/crio-ae883c27bcc9ebc6555b92de3cef5b944536b154be804ba4d30bddaa68ccf9be WatchSource:0}: Error finding container ae883c27bcc9ebc6555b92de3cef5b944536b154be804ba4d30bddaa68ccf9be: Status 404 returned error can't find the container with id ae883c27bcc9ebc6555b92de3cef5b944536b154be804ba4d30bddaa68ccf9be
Oct 30 20:53:02.430506 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.430474    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.430620 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.430561    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.430620 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.430593    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.583056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.583024    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:02.593780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.593739    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" event={"ID":"ddc5d32c-308c-4205-8d75-8d25907a52c4","Type":"ContainerStarted","Data":"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"}
Oct 30 20:53:02.593927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.593811    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" event={"ID":"ddc5d32c-308c-4205-8d75-8d25907a52c4","Type":"ContainerStarted","Data":"bc431d9b2c2c191d919b5e74ba784b2d85e19c25a6d792f9fb9fe7aa45bc16ee"}
Oct 30 20:53:02.608708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.607582    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" event={"ID":"bc03e853-e381-4d38-a47b-2ee6c6e6cb43","Type":"ContainerStarted","Data":"3b2cfbce8f9d21b42cd260cfa1105b11f6c0210f915fe2aacf6e76b6fb334419"}
Oct 30 20:53:02.608708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.607648    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" event={"ID":"bc03e853-e381-4d38-a47b-2ee6c6e6cb43","Type":"ContainerStarted","Data":"def510819ab33c7a5b2dddf406709e1a07990dbed943d680c1832414a7b07f47"}
Oct 30 20:53:02.615063 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.615026    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" event={"ID":"e0d01618-f816-421d-9cbd-7d73db71c606","Type":"ContainerStarted","Data":"667b54a403e9596fadcf81b8effe868f754be4ac39c94302e8a522ed0a49815c"}
Oct 30 20:53:02.615208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.615092    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" event={"ID":"e0d01618-f816-421d-9cbd-7d73db71c606","Type":"ContainerStarted","Data":"ae883c27bcc9ebc6555b92de3cef5b944536b154be804ba4d30bddaa68ccf9be"}
Oct 30 20:53:02.618356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.618325    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" event={"ID":"466a6754-77ac-4419-aca9-6e9f556c0d8a","Type":"ContainerStarted","Data":"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"}
Oct 30 20:53:02.618509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.618368    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" event={"ID":"466a6754-77ac-4419-aca9-6e9f556c0d8a","Type":"ContainerStarted","Data":"5053528c99d115e4db9239357ad1f2c55d12cde4d57673e8c7539f9c3eb93def"}
Oct 30 20:53:02.628973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.628919    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podStartSLOduration=1.628901522 podStartE2EDuration="1.628901522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:02.623412939 +0000 UTC m=+844.427307699" watchObservedRunningTime="2026-10-30 20:53:02.628901522 +0000 UTC m=+844.432796278"
Oct 30 20:53:02.658549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.657869    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podStartSLOduration=1.657851894 podStartE2EDuration="1.657851894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:02.648871252 +0000 UTC m=+844.452766003" watchObservedRunningTime="2026-10-30 20:53:02.657851894 +0000 UTC m=+844.461746640"
Oct 30 20:53:02.678905 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.678499    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podStartSLOduration=1.678485488 podStartE2EDuration="1.678485488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:02.6734279 +0000 UTC m=+844.477322745" watchObservedRunningTime="2026-10-30 20:53:02.678485488 +0000 UTC m=+844.482380271"
Oct 30 20:53:02.702669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.702592    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podStartSLOduration=1.702569953 podStartE2EDuration="1.702569953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:02.70089105 +0000 UTC m=+844.504785799" watchObservedRunningTime="2026-10-30 20:53:02.702569953 +0000 UTC m=+844.506464709"
Oct 30 20:53:02.769832 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.769754    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:02.914983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.914949    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:53:02.915455 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:02.915428    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b3a281_eea1_4a2f_9fd8_a265d53c6ffb.slice/crio-d9243a9d84dd186c012413f44f06dffb743e01bd9a8d479783346a4295bdc35f WatchSource:0}: Error finding container d9243a9d84dd186c012413f44f06dffb743e01bd9a8d479783346a4295bdc35f: Status 404 returned error can't find the container with id d9243a9d84dd186c012413f44f06dffb743e01bd9a8d479783346a4295bdc35f
Oct 30 20:53:02.918248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.918215    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.918357 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.918280    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:02.918357 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.918312    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:03.000019 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:02.999989    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:03.118541 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.118494    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:03.119354 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.119320    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:03.119503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.119378    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:03.398738 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.398639    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:03.686620 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.679088    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" event={"ID":"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb","Type":"ContainerStarted","Data":"bc07f9455a4c4d75890cf196d5d885c44b993eef2c3d1c70163f1030ef3bd6b7"}
Oct 30 20:53:03.708874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.708837    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" event={"ID":"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb","Type":"ContainerStarted","Data":"d9243a9d84dd186c012413f44f06dffb743e01bd9a8d479783346a4295bdc35f"}
Oct 30 20:53:03.709148 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.708734    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podStartSLOduration=1.708712928 podStartE2EDuration="1.708712928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:03.706252705 +0000 UTC m=+845.510147480" watchObservedRunningTime="2026-10-30 20:53:03.708712928 +0000 UTC m=+845.512607685"
Oct 30 20:53:03.788692 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.788644    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:03.788983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:03.788952    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:04.004612 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.004023    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:04.004612 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.004085    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:04.116551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.115926    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:04.116551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.115989    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:04.588551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.587570    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:04.592548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.589388    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:04.592548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.589449    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:04.770960 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.770922    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:04.771262 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:04.771228    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:05.000500 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.000404    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:05.000840 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.000798    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:05.116931 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.116893    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:05.117426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.117386    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:05.216671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.216611    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:05.595544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.595294    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:05.595544 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.595355    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:05.755006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.754964    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:05.772974 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.772934    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:05.773252 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:05.773222    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:06.001169 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.001046    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:06.003129 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.001419    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:06.116224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.116184    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:06.116508 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.116481    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:06.547027 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:53:06.546982    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:53:06.603550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.584981    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:06.603550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.585063    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:06.721564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.716676    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:06.773166 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.773096    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:53:06.776557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.773711    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:53:06.776557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.775316    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:06.776557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:06.775357    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:07.063519 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.063483    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:07.063909 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.063809    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:07.141618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.121943    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:07.173553 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.141911    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:07.426612 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.416160    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:53:07.649547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.642364    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:07.649547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.642435    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:07.771135 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.771100    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:07.771474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:07.771414    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:08.026610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.002117    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:08.026610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.002178    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:08.137565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.133764    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:08.137565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.133830    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:08.615684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.615649    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:08.615965 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.615929    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:08.773607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.770323    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:08.773607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:08.770392    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:09.011608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.010762    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:09.011608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.010827    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:09.115637 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.115569    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:09.116364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.115639    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:09.590023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.589986    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:09.590460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.590430    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:09.767549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.766913    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:09.767549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:09.766992    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 20:53:10.001092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.000991    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 20:53:10.001712 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.001675    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 20:53:10.115965 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.115923    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 20:53:10.116163 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.115997    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 20:53:10.584200 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.584156    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:53:10.584369 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.584246    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 20:53:10.772182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.772153    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:10.772512 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.772492    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:10.773341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:10.773320    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 20:53:11.006038 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.005957    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:11.006495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.006477    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:11.007293 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.007269    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:53:11.120186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.120152    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:11.120585 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.120559    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:11.121239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.121220    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 20:53:11.393923 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.393887    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:11.407632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.407606    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:11.779813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.779785    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:11.780789 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.780762    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:11.781598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.781577    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:53:11.972835 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:11.972803    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:53:14.418548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.417710    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 20:53:14.463549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.457687    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.463549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.461782    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 20:53:14.463549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.461915    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n56bm\""
Oct 30 20:53:14.463549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.461970    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 20:53:14.499561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.487826    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 20:53:14.605595 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.518334    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710556    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710640    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710695    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710754    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710825    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk8v9\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710868    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.715550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.710942    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.825970    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826052    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826102    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826159    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826226    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk8v9\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826271    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.826345    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.827554 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.827240    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.922548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.914940    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.956588 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.954203    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.972425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.972391    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.979933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.974131    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.980170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.974174    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk8v9\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:14.980290 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:14.979364    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5lhdq\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:15.123823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:15.123789    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:15.210668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:15.209480    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:15.436546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:15.429624    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:15.439713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:15.439668    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:15.780471 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:15.780408    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 20:53:15.781098 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:15.781076    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb30b50_5fce_4b15_be61_6ed645814cd3.slice/crio-d8cace61d311bf0aa31c0fc2918d75a52f9dad3851f0177f9727b9814127f59e WatchSource:0}: Error finding container d8cace61d311bf0aa31c0fc2918d75a52f9dad3851f0177f9727b9814127f59e: Status 404 returned error can't find the container with id d8cace61d311bf0aa31c0fc2918d75a52f9dad3851f0177f9727b9814127f59e
Oct 30 20:53:16.135357 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:16.135269    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" event={"ID":"ccb30b50-5fce-4b15-be61-6ed645814cd3","Type":"ContainerStarted","Data":"d8cace61d311bf0aa31c0fc2918d75a52f9dad3851f0177f9727b9814127f59e"}
Oct 30 20:53:16.949598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:16.949564    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:53:16.955515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:16.955492    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:16.973388 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:16.973365    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:53:17.003969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.003940    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.005239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005210    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005253    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005500    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005594    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005650    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlvbx\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005703    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005778    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.006194 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.005813    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.020251 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.020226    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:53:17.025885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.025862    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.037556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.037512    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:53:17.107072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107031    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107085    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107120    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107179    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107381    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107482    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107485    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdgw\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107562    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107603    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107623    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107645    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107662    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107678    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlvbx\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107701    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107723    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107744    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107781    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107799    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107846    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.107896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.107867    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.108609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.108582    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.109295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.109270    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.110704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.110682    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.111221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.111201    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.111829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.111809    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.121928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.121907    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.122822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.122793    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlvbx\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.209684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209602    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209647    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209675    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209695    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209829    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209874    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.209986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.209931    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210115    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210118    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210220    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210236    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdgw\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210460 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210436    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210445    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.210691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.210661    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.212490 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.212467    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.212942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.212920    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.223055 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.223030    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdgw\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.223470 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.223454    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\") pod \"e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") " pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.271009 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.270975    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:17.345285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.345146    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:17.355366 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.350092    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:53:17.385383 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.385348    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:53:17.386622 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.385660    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422066    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422137    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422219    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422307    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422368    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422578    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422622    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqbjx\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422665    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.422805 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.422787    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.528152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.528113    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.528661 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.528624    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqbjx\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.528851 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.528832    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.528676    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529052    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529129    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529169    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529216    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529287    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529333    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529646    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.530123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.529821    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.531028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.530721    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.531028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.530984    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.539125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.539096    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.541131 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.541105    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.607807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.607771    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.607967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.607828    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqbjx\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.707139 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.707093    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:17.732260 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.732095    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:53:17.735904 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:17.735866    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1668fb16_2f70_40d5_be0d_dc505a50c774.slice/crio-fcf91c04de34769884346ad34efd608baa2a99e10c6b39f0254ce4eef8dd3653 WatchSource:0}: Error finding container fcf91c04de34769884346ad34efd608baa2a99e10c6b39f0254ce4eef8dd3653: Status 404 returned error can't find the container with id fcf91c04de34769884346ad34efd608baa2a99e10c6b39f0254ce4eef8dd3653
Oct 30 20:53:17.738615 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.738581    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:17.738727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.738664    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:17.738727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.738710    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:17.853317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.853283    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:53:17.859443 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.859404    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:17.859564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.859494    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:17.859648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:17.859561    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:18.070007 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.069923    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:53:18.079672 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.079639    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:18.079848 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.079715    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:18.079848 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.079751    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:18.179578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.178462    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" event={"ID":"1668fb16-2f70-40d5-be0d-dc505a50c774","Type":"ContainerStarted","Data":"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"}
Oct 30 20:53:18.179578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.178548    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" event={"ID":"1668fb16-2f70-40d5-be0d-dc505a50c774","Type":"ContainerStarted","Data":"fcf91c04de34769884346ad34efd608baa2a99e10c6b39f0254ce4eef8dd3653"}
Oct 30 20:53:18.184097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.183968    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" event={"ID":"4bf92ecc-3fef-4d23-9950-f7bb882f633a","Type":"ContainerStarted","Data":"d7dfd21cc193a842b3c9a564879ad683170096de4ff60085983e95d2e999bad6"}
Oct 30 20:53:18.184097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.184057    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" event={"ID":"4bf92ecc-3fef-4d23-9950-f7bb882f633a","Type":"ContainerStarted","Data":"8599ca1fb06554e959b345a6375fdda40c5349b8cd8b598468984b3bbdd70e17"}
Oct 30 20:53:18.187602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.187515    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" event={"ID":"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c","Type":"ContainerStarted","Data":"4b6b06fdaf408626847e5087450c49e594c1e8a83fd7647e90fd4d84eb674771"}
Oct 30 20:53:18.220739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.220689    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podStartSLOduration=2.220673598 podStartE2EDuration="2.220673598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:18.205284465 +0000 UTC m=+860.009179253" watchObservedRunningTime="2026-10-30 20:53:18.220673598 +0000 UTC m=+860.024568366"
Oct 30 20:53:18.229540 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.229480    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podStartSLOduration=2.229466399 podStartE2EDuration="2.229466399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:18.226910843 +0000 UTC m=+860.030805623" watchObservedRunningTime="2026-10-30 20:53:18.229466399 +0000 UTC m=+860.033361221"
Oct 30 20:53:18.274208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.274129    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:18.274208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.274189    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:18.274449 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.274245    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:18.347618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.347516    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:18.349099 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.349070    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:18.349327 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:18.349303    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:19.285014 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.283583    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" event={"ID":"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c","Type":"ContainerStarted","Data":"17c077cf9a71ea33282e4ca191c7ff9805d1fd9962e4a2914e1cf13173397617"}
Oct 30 20:53:19.285014 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.284726    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:19.285014 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.284772    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:19.374551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.354973    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:19.374551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.355036    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:19.707595 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.707486    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:19.709869 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.709834    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:19.710015 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:19.709899    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:20.279556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.278149    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:20.279556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.278232    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:20.354549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.352964    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:20.354549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.353025    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:20.719075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.718973    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:20.719075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:20.719060    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:21.274096 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.274057    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:21.274412 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.274382    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:21.349556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.348203    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:21.349556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.348262    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:21.712108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.712011    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:21.712728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:21.712683    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:22.320561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.294348    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:22.321270 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.320865    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:22.393549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.348854    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:22.393549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.348909    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:22.708214 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.708125    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:22.708481 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:22.708434    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:23.286575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.286149    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:23.286575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.286227    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:23.349462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.349001    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:23.349462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.349065    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:23.718570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.718036    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:23.718570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:23.718124    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:24.272147 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.272103    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:53:24.272350 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.272168    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 20:53:24.357276 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.356800    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 20:53:24.357276 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.356863    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 20:53:24.664496 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.664025    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:24.664496 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.664106    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:24.710804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.710632    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 20:53:24.710804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:24.710721    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 20:53:25.538636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.537856    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" event={"ID":"ccb30b50-5fce-4b15-be61-6ed645814cd3","Type":"ContainerStarted","Data":"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"}
Oct 30 20:53:25.562607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.559915    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:25.563455 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.563425    5115 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-5lhdq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:53:25.587549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.563667    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:53:25.625320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.590758    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podStartSLOduration=8.590737924999999 podStartE2EDuration="8.590737925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:19.337923599 +0000 UTC m=+861.141818357" watchObservedRunningTime="2026-10-30 20:53:25.590737925 +0000 UTC m=+867.394632682"
Oct 30 20:53:25.653552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.632467    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" podStartSLOduration=2.753194266 podStartE2EDuration="11.632448463s" totalImagesPullingTime="8.879254197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:25.629872552 +0000 UTC m=+867.433767291" watchObservedRunningTime="2026-10-30 20:53:25.632448463 +0000 UTC m=+867.436343221"
Oct 30 20:53:25.805601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.805099    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:25.810547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.806096    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:25.810547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.806894    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:53:25.991963 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.991796    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:25.992514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.992488    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:25.995137 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:25.995115    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:53:26.245195 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:26.245106    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:26.245483 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:26.245460    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:26.246422 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:26.246402    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:53:26.547810 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:26.547783    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 20:53:32.187546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.187088    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:53:32.200502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.195413    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:53:32.200502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.195548    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.286717 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.286673    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.286927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.286729    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.286927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.286836    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.286927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.286903    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx5lr\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.287120 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.286986    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.287120 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.287030    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.287239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.287147    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.287239 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.287214    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.287356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.287279    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.391353 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.391311    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.391705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.391680    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx5lr\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.391879 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.391861    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.391977    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392087    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392272    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392444    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392716 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392694    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.392970 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392943    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.393064 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.392989    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.396149    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.396885    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.397353    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.397968    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.398154    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.398904 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.398883    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.405355 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.405287    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx5lr\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.454250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.448079    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:32.525552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:32.517996    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:33.138591 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.138555    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:53:33.140902 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:33.140873    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf86b921_4cd5_4d32_8de0_b7eedfde295b.slice/crio-0bf45a48a2053e3a4af62b89e275e08dab75a6fcafa095810edf0ddcd9050b55 WatchSource:0}: Error finding container 0bf45a48a2053e3a4af62b89e275e08dab75a6fcafa095810edf0ddcd9050b55: Status 404 returned error can't find the container with id 0bf45a48a2053e3a4af62b89e275e08dab75a6fcafa095810edf0ddcd9050b55
Oct 30 20:53:33.143891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.143858    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:33.143997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.143943    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:33.144067 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.143992    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:33.673467 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.673426    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" event={"ID":"df86b921-4cd5-4d32-8de0-b7eedfde295b","Type":"ContainerStarted","Data":"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"}
Oct 30 20:53:33.674063 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.673495    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" event={"ID":"df86b921-4cd5-4d32-8de0-b7eedfde295b","Type":"ContainerStarted","Data":"0bf45a48a2053e3a4af62b89e275e08dab75a6fcafa095810edf0ddcd9050b55"}
Oct 30 20:53:33.702734 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:33.702675    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podStartSLOduration=1.7026594510000002 podStartE2EDuration="1.702659451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:33.700179592 +0000 UTC m=+875.504074375" watchObservedRunningTime="2026-10-30 20:53:33.702659451 +0000 UTC m=+875.506554207"
Oct 30 20:53:34.561642 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:34.559668    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:34.562681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:34.562626    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:34.562830 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:34.562686    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:35.558345 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:35.558304    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:35.558888 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:35.558852    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:36.293624 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:53:36.293573    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:53:36.545491 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:36.545396    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:36.546367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:36.546327    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:37.548034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:37.547994    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:37.548701 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:37.548666    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:38.548812 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:38.548780    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:38.549301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:38.548833    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:39.545694 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:39.545651    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 20:53:39.545903 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:39.545721    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 20:53:40.549542 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:40.549492    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:40.549980 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:40.549947    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:40.550928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:40.550903    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:53:46.506499 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.506458    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 20:53:46.512755 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.512726    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.523821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.523787    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 20:53:46.655339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655302    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655439    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655468    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655513    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-768lp\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655697 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655606    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655697 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655649    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655697 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655674    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655804 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655780    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.655839 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.655809    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757483    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757590    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757779 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757693    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757778    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-768lp\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757813    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757878    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.757943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757919    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.757979    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758010    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758245 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758218    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758407    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758419    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758396    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.758556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.758473    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.760175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.760151    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.760779 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.760665    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.769378 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.769326    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-768lp\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.769558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.769415    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\") pod \"e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") " pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:46.840495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:46.840461    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:47.161138 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.161097    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 20:53:47.162056 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:47.162027    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7a5906_0fa1_4c77_8792_ccca15f52d56.slice/crio-f67b0a1a2a0a85a39b8f317f66a80ea9124c66bdea85350f5c64226160883470 WatchSource:0}: Error finding container f67b0a1a2a0a85a39b8f317f66a80ea9124c66bdea85350f5c64226160883470: Status 404 returned error can't find the container with id f67b0a1a2a0a85a39b8f317f66a80ea9124c66bdea85350f5c64226160883470
Oct 30 20:53:47.164780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.164741    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.164893 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.164832    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.164893 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.164878    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.179805 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.179777    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:53:47.187734 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.187705    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.202469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.202438    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:53:47.373304 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373264    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373666 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373455    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373666 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373515    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfj5z\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373765 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373665    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373765 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373716    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373797    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373822    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373844    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.373993 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.373976    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475340    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475399    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475429    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475539    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475596    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.475767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.475704    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476367    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfj5z\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476402    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476493    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476499    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476698 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476588    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476804    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.476998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.476973    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.477159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.477136    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.478766 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.478732    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.478985 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.478967    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.488086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.488063    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.488496 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.488480    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfj5z\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\") pod \"e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") " pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.510447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.510418    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:47.813374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.813211    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:53:47.816615 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:53:47.816583    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bed789a_d64d_4811_b031_d7e9647dc93d.slice/crio-ac336e8cab8743f433819bde10e03244fd7feceae388873a2dcc017c5e29bb64 WatchSource:0}: Error finding container ac336e8cab8743f433819bde10e03244fd7feceae388873a2dcc017c5e29bb64: Status 404 returned error can't find the container with id ac336e8cab8743f433819bde10e03244fd7feceae388873a2dcc017c5e29bb64
Oct 30 20:53:47.819217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.819186    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.819300 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.819266    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.819339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.819305    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:53:47.833224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.833189    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" event={"ID":"5bed789a-d64d-4811-b031-d7e9647dc93d","Type":"ContainerStarted","Data":"ac336e8cab8743f433819bde10e03244fd7feceae388873a2dcc017c5e29bb64"}
Oct 30 20:53:47.835174 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.835141    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" event={"ID":"bf7a5906-0fa1-4c77-8792-ccca15f52d56","Type":"ContainerStarted","Data":"a45cdae4fcd189e966b96685e4e528a686b24e395c1206982ffa30bf6eba1290"}
Oct 30 20:53:47.835307 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.835201    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" event={"ID":"bf7a5906-0fa1-4c77-8792-ccca15f52d56","Type":"ContainerStarted","Data":"f67b0a1a2a0a85a39b8f317f66a80ea9124c66bdea85350f5c64226160883470"}
Oct 30 20:53:47.840904 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.840877    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:47.855688 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:47.855629    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podStartSLOduration=1.855612716 podStartE2EDuration="1.855612716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:47.854851732 +0000 UTC m=+889.658746511" watchObservedRunningTime="2026-10-30 20:53:47.855612716 +0000 UTC m=+889.659507475"
Oct 30 20:53:48.847938 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:48.847894    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:48.848471 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:48.847962    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:48.864867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:48.864831    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" event={"ID":"5bed789a-d64d-4811-b031-d7e9647dc93d","Type":"ContainerStarted","Data":"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"}
Oct 30 20:53:49.512624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:49.511421    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:49.512996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:49.512973    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:49.513091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:49.513018    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:49.842998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:49.842952    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:49.843311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:49.843276    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:50.511740 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:50.510768    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:50.511740 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:50.510815    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:50.841996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:50.841955    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:50.842315 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:50.842276    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:51.511211 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:51.511182    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:51.511443 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:51.511422    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:51.860125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:51.859655    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:51.860125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:51.859720    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:52.510816 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:52.510784    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:52.510996 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:52.510832    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:52.848551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:52.843958    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:52.848551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:52.844023    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:53.510956 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:53.510914    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:53.511377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:53.510970    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:53.840973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:53.840934    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:53:53.841236 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:53.841208    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 20:53:54.512100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:54.511737    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:54.512100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:54.511801    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:55.059433 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.059367    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:55.060862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.060840    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:55.061800 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.061776    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 20:53:55.089290 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.089227    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podStartSLOduration=8.089209314 podStartE2EDuration="8.089209314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:48.946984115 +0000 UTC m=+890.750878883" watchObservedRunningTime="2026-10-30 20:53:55.089209314 +0000 UTC m=+896.893104071"
Oct 30 20:53:55.510871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.510792    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:53:55.510871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:55.510840    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 20:53:56.516928 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:56.516884    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:56.517564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:56.517511    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:56.518504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:56.518479    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:53:58.937551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:58.936624    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:53:59.154103 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:53:59.154075    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:54:00.474700 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:00.446603    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:00.474700 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:00.463654    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:00.578549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:00.577934    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:54:00.973550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:00.972611    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:01.508274 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:01.508229    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:01.541613 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:01.541582    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:54:01.587295 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:01.581133    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:01.624579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:01.618278    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:54:02.003643 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:02.003346    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:54:02.026869 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:02.017971    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:54:06.280863 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:54:06.280815    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:54:17.337010 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.336977    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 20:54:17.341915 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.341886    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.364364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.364334    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 20:54:17.420398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420354    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420393    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420682 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420428    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420682 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420664    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420802 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420729    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbcbx\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420914    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.420998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.420986    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.421154 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.421138    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.421212 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.421196    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.522678 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.522640    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.522678 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.522691    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.522976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.522843    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.522976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.522909    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.522976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.522963    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523023    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523062    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbcbx\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523136    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523347 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523232    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523347 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523301    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523459 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523379    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.523709 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523684    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.525127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.523883    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.525336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.525053    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.538887 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.527727    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.540875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.540649    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.544128 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.543736    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.544484 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.544459    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbcbx\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.665824 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.665737    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:17.992781 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.992695    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 20:54:17.996314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.996278    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:17.996414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.996346    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:17.996414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:17.996377    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:19.079551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.076410    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" event={"ID":"11dc7685-6491-4e40-88b6-a8b1e1886382","Type":"ContainerStarted","Data":"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"}
Oct 30 20:54:19.079551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.076475    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" event={"ID":"11dc7685-6491-4e40-88b6-a8b1e1886382","Type":"ContainerStarted","Data":"25ea8b262f7724a05cfb86b87a38cf10fc643ef2488e855a8cd05fd4db21e171"}
Oct 30 20:54:19.671550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.670609    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:19.675548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.674647    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:19.675548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.674709    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:19.963603 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:19.962510    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:20.024546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:20.023637    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:54:20.522592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:20.482685    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:20.720559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:20.667010    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:20.720559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:20.667387    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:21.032769 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.032672    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:21.079548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.033192    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:54:21.113505 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.107279    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podStartSLOduration=4.107246048 podStartE2EDuration="4.107246048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:19.121958028 +0000 UTC m=+920.925852811" watchObservedRunningTime="2026-10-30 20:54:21.107246048 +0000 UTC m=+922.911140804"
Oct 30 20:54:21.139552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.135016    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:54:21.203557 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.143462    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:54:21.486894 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.486783    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:21.547809 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.547757    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:54:21.806551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.782773    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:21.806551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:21.782899    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:22.051566 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.033324    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:22.073797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.073700    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:54:22.142717 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.142670    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:54:22.414339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.413474    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:22.605592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.604627    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:22.968896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.968859    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:22.969237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:22.969188    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:23.109257 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.109200    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:54:23.110214 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.110191    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:54:23.111641 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.111617    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:54:23.155338 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.155295    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:54:23.178131 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.177628    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:54:23.388342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.388305    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:54:23.389114 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.388924    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:54:23.392490 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.392440    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:54:23.666179 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.666095    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:23.666179 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:23.666155    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:24.668408 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:24.666195    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:24.668408 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:24.666263    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:25.667050 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:25.667000    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:25.667266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:25.667071    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:26.666083 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:26.666049    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:26.666728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:26.666109    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:27.666650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:27.666612    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:54:27.667187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:27.666671    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 20:54:28.671108 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:28.671077    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:28.671578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:28.671556    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:28.672398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:28.672378    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 20:54:32.541852 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.541817    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:54:32.548927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.548902    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.562671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.562642    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:54:32.691674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691637    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.691901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691800    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.691901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691840    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.691901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691882    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.692094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691945    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.692094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.691982    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.692094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.692009    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.692094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.692057    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.692495 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.692459    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5pks\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.793999    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794053    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794092 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794084    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794128    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794150    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794174    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794214    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794338    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5pks\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794466    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794556    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794587    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794682    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.794822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.794689    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.795224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.795199    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.796914 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.796889    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.797129 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.797102    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.807691 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.807659    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5pks\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.808384 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.808351    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\") pod \"e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") " pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:32.876866 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:32.876826    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:33.175126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.175095    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:54:33.176587 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:54:33.176552    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6b4bf7_b270_4962_99d8_1ba5fd227745.slice/crio-a593da476bca8882d5f5b5a78abcea7b630b12c90054d67938fcbf9e1f9ef06e WatchSource:0}: Error finding container a593da476bca8882d5f5b5a78abcea7b630b12c90054d67938fcbf9e1f9ef06e: Status 404 returned error can't find the container with id a593da476bca8882d5f5b5a78abcea7b630b12c90054d67938fcbf9e1f9ef06e
Oct 30 20:54:33.179513 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.179482    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:33.179629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.179572    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:33.179629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.179608    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:33.668348 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.668315    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" event={"ID":"1c6b4bf7-b270-4962-99d8-1ba5fd227745","Type":"ContainerStarted","Data":"a3478006da9c9e3a78e4cbaeced63ea00d317141e0f6cabff3349ef40fc01410"}
Oct 30 20:54:33.668818 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.668373    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" event={"ID":"1c6b4bf7-b270-4962-99d8-1ba5fd227745","Type":"ContainerStarted","Data":"a593da476bca8882d5f5b5a78abcea7b630b12c90054d67938fcbf9e1f9ef06e"}
Oct 30 20:54:33.691964 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.691901    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podStartSLOduration=1.6918833530000001 podStartE2EDuration="1.691883353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:33.688469045 +0000 UTC m=+935.492363858" watchObservedRunningTime="2026-10-30 20:54:33.691883353 +0000 UTC m=+935.495778110"
Oct 30 20:54:33.877510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:33.877478    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:34.878809 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:34.878767    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:34.879222 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:34.878825    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:35.877331 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:35.877297    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:35.877516 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:35.877360    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:36.281961 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:54:36.281922    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:54:36.877206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:36.877173    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:36.877389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:36.877220    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:37.878221 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:37.878183    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:37.878759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:37.878258    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:38.877285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:38.877207    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:38.877285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:38.877253    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:39.877537 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:39.877489    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 20:54:39.878041 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:39.877597    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 20:54:40.884502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:40.884469    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:40.886001 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:40.885979    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:40.886457 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:40.886438    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:54:46.886179 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:46.886144    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:54:46.890917 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:46.890893    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:46.909840 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:46.909809    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:54:47.013007 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.012972    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 20:54:47.017945 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.017923    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.028066 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.028044    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 20:54:47.038629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.038595    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.038844 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.038799    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039014 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.038993    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039063    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039206    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtvm\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039642    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039701    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039766    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.039807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.039792    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.140986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.140892    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.140986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.140952    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.140986 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.140977    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.141373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141019    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141087    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141165    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.141373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141197    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.141373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141303    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtvm\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141372    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141440    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141452    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.141648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141509    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.141853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141666    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141701    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141732    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141760    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.141853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141834    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.142094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141876    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.142094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.141985    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.142094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.142047    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.142377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.142336    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.142482 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.142435    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwz7\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.142613 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.142594    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.143979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.143953    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.144195 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.144175    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.152964 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.152930    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtvm\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.154644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.154625    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\") pod \"e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") " pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.213075 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.213043    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:47.244008 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.243967    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwz7\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244046    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244073    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244149 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244143    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244174    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244295    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.244831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.244773    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245193    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245245    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245399    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245447    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245491    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.245811    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.246693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.246337    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.248871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.248723    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.249510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.249489    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.255672 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.255649    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwz7\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.256684 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.256651    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.337349 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.337304    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:47.535288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.535253    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:54:47.537366 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:54:47.537337    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d227f8_3db0_4563_bdaa_9a400c817748.slice/crio-1e322cb0ebb8973fe7e833604e8d2521eec6abcaedacba2960c40adf6856d3dc WatchSource:0}: Error finding container 1e322cb0ebb8973fe7e833604e8d2521eec6abcaedacba2960c40adf6856d3dc: Status 404 returned error can't find the container with id 1e322cb0ebb8973fe7e833604e8d2521eec6abcaedacba2960c40adf6856d3dc
Oct 30 20:54:47.540909 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.540872    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.541003 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.540983    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.541056 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.541030    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.667345 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.667310    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 20:54:47.670678 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:54:47.670645    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a7f94d_774e_4d1f_b51b_edee859f2919.slice/crio-482f3ec5000fab9ec5cf2b2a6f23f727dc9e9864281526bffd51181aab932705 WatchSource:0}: Error finding container 482f3ec5000fab9ec5cf2b2a6f23f727dc9e9864281526bffd51181aab932705: Status 404 returned error can't find the container with id 482f3ec5000fab9ec5cf2b2a6f23f727dc9e9864281526bffd51181aab932705
Oct 30 20:54:47.673027 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.672991    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.673133 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.673079    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.673133 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.673124    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:47.803798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.803752    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" event={"ID":"b6d227f8-3db0-4563-bdaa-9a400c817748","Type":"ContainerStarted","Data":"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"}
Oct 30 20:54:47.803950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.803826    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" event={"ID":"b6d227f8-3db0-4563-bdaa-9a400c817748","Type":"ContainerStarted","Data":"1e322cb0ebb8973fe7e833604e8d2521eec6abcaedacba2960c40adf6856d3dc"}
Oct 30 20:54:47.807376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.807343    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" event={"ID":"74a7f94d-774e-4d1f-b51b-edee859f2919","Type":"ContainerStarted","Data":"2ee05cb28044d5f474f8af909c113126edea7d3ec43de38238d8f98d84bcc51e"}
Oct 30 20:54:47.807570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.807399    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" event={"ID":"74a7f94d-774e-4d1f-b51b-edee859f2919","Type":"ContainerStarted","Data":"482f3ec5000fab9ec5cf2b2a6f23f727dc9e9864281526bffd51181aab932705"}
Oct 30 20:54:47.828738 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.828678    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podStartSLOduration=1.828652086 podStartE2EDuration="1.828652086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:47.827121258 +0000 UTC m=+949.631016030" watchObservedRunningTime="2026-10-30 20:54:47.828652086 +0000 UTC m=+949.632546847"
Oct 30 20:54:47.856088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:47.856027    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podStartSLOduration=1.856006415 podStartE2EDuration="1.856006415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:47.847086447 +0000 UTC m=+949.650981220" watchObservedRunningTime="2026-10-30 20:54:47.856006415 +0000 UTC m=+949.659901174"
Oct 30 20:54:48.214074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.214035    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:48.215695 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.215670    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:48.215852 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.215722    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:48.338469 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.338437    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:48.340062 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.340035    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:48.340184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:48.340086    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:49.214116 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:49.213610    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:49.214116 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:49.213699    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:49.342051 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:49.342009    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:49.342364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:49.342326    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:50.214028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:50.213999    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:50.214347 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:50.214289    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:50.355551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:50.355024    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:50.355551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:50.355091    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:51.213648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:51.213615    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:51.213794 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:51.213681    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:51.340195 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:51.340160    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:51.340848 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:51.340797    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:52.215603 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:52.215572    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:52.215963 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:52.215925    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:52.366548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:52.365882    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:52.366548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:52.365958    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:53.213833 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:53.213777    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:53.214100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:53.214072    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:53.359596 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:53.347929    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:53.359596 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:53.348010    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:54.213404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:54.213364    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 20:54:54.213934 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:54.213432    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 20:54:54.338032 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:54.337992    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 20:54:54.338232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:54.338065    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 20:54:55.706983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.706947    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:55.708329 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.708293    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:55.711131 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.709700    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:54:55.736116 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.736082    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:55.736626 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.736561    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:54:55.737565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:54:55.737546    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 20:55:01.574550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:01.565840    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:02.133566 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.131342    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:02.145674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.145625    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:55:02.459611 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.399629    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:02.459611 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.441905    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/health\": context deadline exceeded"
Oct 30 20:55:02.613601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.596784    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:02.614113 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:02.613739    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:55:03.152559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.148986    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:03.156136 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.156097    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:55:03.186669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.186619    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:55:03.187323 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.187297    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:55:03.401551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.399818    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:03.401551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.400612    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:55:03.625613 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:03.622259    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:04.176552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:04.173587    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:04.267550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:04.266670    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:04.499637 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:04.480911    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:55:04.675695 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:04.675639    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:05.119782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.119737    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:05.191334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.191278    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:55:05.284550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.278585    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:55:05.341891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.341586    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": context deadline exceeded"
Oct 30 20:55:05.493912 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.493794    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:05.744610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:05.718910    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:06.195755 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:06.195693    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:55:06.287462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:06.287413    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:06.526559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:06.521704    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:06.720901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:06.720847    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:07.208922 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:07.207709    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:55:07.310728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:07.310670    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:07.525634 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:55:07.520791    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:55:07.559549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:07.534402    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:55:07.729549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:07.728861    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:08.219739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.219692    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:08.450725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.450658    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:08.643348 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.643300    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:08.679266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.679236    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:55:08.681324 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.681298    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:55:08.683146 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.683125    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:55:08.688471 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:08.688446    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:55:32.289220 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.289181    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 20:55:32.296185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.296157    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.306836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.306807    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 20:55:32.426152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426120    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426172    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426263    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426411 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426376    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75lr8\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426446 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426410    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426492    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426718 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426665    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426719    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.426780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.426772    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528043 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528005    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528247 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528172    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528254    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528368 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528342    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528407    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528489 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528470    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528811    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528831    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528821    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75lr8\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528514    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.528882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.528882    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.529259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.529039    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.529259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.529149    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.529259 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.529177    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.531187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.531162    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.531474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.531453    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.540478 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.540417    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75lr8\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.540630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.540518    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\") pod \"e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") " pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.615238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.615197    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 20:55:32.621224 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.621200    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.624248 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.624218    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:32.631235 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631199    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631281    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vxk\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631317    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631352    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631380    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631423    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631496    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631574    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.631891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.631641    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.635881 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.635856    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 20:55:32.732948 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.732917    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.733394 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733371    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.733599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733581    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vxk\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.733748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733729    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.733884 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733866    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.733997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733983    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.734144 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.734127    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.734346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.734328    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.734467 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.734452    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.735700 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.735638    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.735932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733631    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.736385 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.736363    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.739669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.736630    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.739669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.733873    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.740226 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.740081    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.745494 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.745089    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.757184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.756298    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.757314 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.757208    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vxk\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\") pod \"e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") " pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.942808 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.942729    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:32.967730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.967698    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 20:55:32.971306 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.971253    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:32.971397 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.971372    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:32.971445 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:32.971428    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:33.276782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.276747    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 20:55:33.282007 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:55:33.281972    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebdfff8_d160_4f26_b62c_0de75c84673b.slice/crio-232abaaeeda03abd539c6fd3335346b7079da8577ae0072bdbcce13e60730909 WatchSource:0}: Error finding container 232abaaeeda03abd539c6fd3335346b7079da8577ae0072bdbcce13e60730909: Status 404 returned error can't find the container with id 232abaaeeda03abd539c6fd3335346b7079da8577ae0072bdbcce13e60730909
Oct 30 20:55:33.284782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.284751    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:33.284862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.284819    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:33.284862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.284848    5115 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:33.741783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.741670    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" event={"ID":"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4","Type":"ContainerStarted","Data":"75c0709761b87c3a43de27deeddf0c2a84d8993ed20ddc85d0422cb595ab046e"}
Oct 30 20:55:33.742289 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.742260    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" event={"ID":"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4","Type":"ContainerStarted","Data":"fd3eec3725f831c13dff938304001ab52d9c6a5bfabbd0066d0e09516983ce0b"}
Oct 30 20:55:33.745184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.745150    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" event={"ID":"5ebdfff8-d160-4f26-b62c-0de75c84673b","Type":"ContainerStarted","Data":"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"}
Oct 30 20:55:33.745336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.745209    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" event={"ID":"5ebdfff8-d160-4f26-b62c-0de75c84673b","Type":"ContainerStarted","Data":"232abaaeeda03abd539c6fd3335346b7079da8577ae0072bdbcce13e60730909"}
Oct 30 20:55:33.780933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.780870    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podStartSLOduration=1.7808549089999999 podStartE2EDuration="1.780854909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:33.774109901 +0000 UTC m=+995.578004679" watchObservedRunningTime="2026-10-30 20:55:33.780854909 +0000 UTC m=+995.584749665"
Oct 30 20:55:33.800729 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.800679    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podStartSLOduration=1.800656897 podStartE2EDuration="1.800656897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:33.796264284 +0000 UTC m=+995.600159061" watchObservedRunningTime="2026-10-30 20:55:33.800656897 +0000 UTC m=+995.604551654"
Oct 30 20:55:33.943167 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:33.943128    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:34.675550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:34.671110    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:34.676992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:34.676504    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:34.676992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:34.676576    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:34.975410 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:34.975199    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:34.975410 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:34.975301    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:35.648431 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:35.648144    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:35.648431 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:35.648232    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:35.947606 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:35.946380    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:35.947606 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:35.946926    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:36.304620 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:55:36.304572    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:55:36.628654 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:36.628555    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:36.628654 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:36.628636    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:36.953023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:36.952927    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:36.953286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:36.953255    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:37.668555 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:37.650422    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:37.680595 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:37.650501    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:37.949605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:37.944969    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:37.949605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:37.945039    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:38.627546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:38.625928    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:38.627546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:38.625994    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:38.994610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:38.969114    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:38.994610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:38.969222    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:39.533238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.533192    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:39.683264 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.682848    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:39.683264 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.682905    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:39.708915 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.708874    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:39.726918 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.726605    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": context deadline exceeded"
Oct 30 20:55:39.944604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.943937    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:39.944604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:39.944016    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:40.200608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.200212    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:40.274559 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.272644    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:40.475579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.461575    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7100-489caf"]
Oct 30 20:55:40.477208 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.477180    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:55:40.492776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.492741    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vvpgk\""
Oct 30 20:55:40.598549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.595805    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:55:40.598549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.596814    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:55:40.650552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.645251    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:40.650552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.645323    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:40.767932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.726581    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7100-489caf"]
Oct 30 20:55:40.767932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.726690    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:40.767932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.727147    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:55:40.854258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.800954    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zvfx\" (UniqueName: \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\") pod \"test-curl-7100-489caf\" (UID: \"ff6368c8-4353-4ffa-9fca-371f3b178bb0\") " pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:55:41.108100 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:40.917735    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zvfx\" (UniqueName: \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\") pod \"test-curl-7100-489caf\" (UID: \"ff6368c8-4353-4ffa-9fca-371f3b178bb0\") " pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:55:41.387803 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.228598    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:41.387803 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.260475    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:41.387803 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.383603    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:41.387803 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.275312    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:41.426681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.420478    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:55:41.426681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.420568    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:55:41.454586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.446674    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zvfx\" (UniqueName: \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\") pod \"test-curl-7100-489caf\" (UID: \"ff6368c8-4353-4ffa-9fca-371f3b178bb0\") " pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:55:41.607566 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.601663    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:41.647633 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.638764    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:55:41.670599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.660694    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:55:41.670599 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.660757    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 20:55:41.747553 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.739889    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:41.863579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.825640    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:41.863579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:41.825710    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.080071 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.080029    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:42.088902 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.088851    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.137670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.092787    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:42.137955 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.137919    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:42.138088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.121159    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:42.138205 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.138187    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.392162 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.392062    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.423957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.423908    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.436778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.436725    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.638693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.612611    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:42.799680 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:42.799626    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:55:43.026150 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.026117    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:43.029553 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.026395    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:43.046094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.045872    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:43.063793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.063695    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:43.408607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.405149    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:43.440737 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.439908    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:43.639549 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:55:43.606460    5115 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.225s"
Oct 30 20:55:43.697417 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.639797    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:43.698098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.697653    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:55:43.786755 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.786717    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:43.787036 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.787005    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:43.983420 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.982857    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 20:55:43.983420 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:43.982921    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 20:55:44.413693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:44.413638    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:44.450362 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:44.450314    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:55:44.748618 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:44.724133    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:55:44.870758 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:44.860992    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:44.870758 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:44.861066    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:45.039335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.039297    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:45.039665 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.039618    5115 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:45.199597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.198174    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:45.199978 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.199884    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:45.256823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.256777    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:55:45.262916 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.262892    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:45.286493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.286143    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:55:45.287598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.287579    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:55:45.287784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.287771    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:45.292825 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.291886    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:55:45.296434 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.292454    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 20:55:45.301583 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.301555    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7100-489caf"]
Oct 30 20:55:45.478467 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.478430    5115 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:45.479404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.479380    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:45.480277 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:45.480257    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 20:55:46.190603 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:46.190501    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7100-489caf" event={"ID":"ff6368c8-4353-4ffa-9fca-371f3b178bb0","Type":"ContainerStarted","Data":"e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195"}
Oct 30 20:55:46.190807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:46.190624    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7100-489caf" event={"ID":"ff6368c8-4353-4ffa-9fca-371f3b178bb0","Type":"ContainerStarted","Data":"2e088c1be39346327ced23348e543163ec44eeb8dd13e768e254f56df6ca82e7"}
Oct 30 20:55:46.211294 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:46.210957    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7100-489caf" podStartSLOduration=5.518533208 podStartE2EDuration="6.210940889s" totalImagesPullingTime="692.407681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:46.209886429 +0000 UTC m=+1008.013781186" watchObservedRunningTime="2026-10-30 20:55:46.210940889 +0000 UTC m=+1008.014835646"
Oct 30 20:55:55.289159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.289121    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:55:55.298519 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.298464    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.306401 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.306371    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ab941206-dockercfg-gcbvg\""
Oct 30 20:55:55.306582 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.306446    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ab941206\""
Oct 30 20:55:55.309893 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.307584    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:55:55.407162 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.394559    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.407162 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.394933    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpwx\" (UniqueName: \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.541047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.540957    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpwx\" (UniqueName: \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.541395 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.541373    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.543475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.543450    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.584232 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.582562    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpwx\" (UniqueName: \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\") pod \"payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") " pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.626900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.626870    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:55.986676 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:55:55.986647    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf18e1c_26b3_4ad5_908d_67523245519d.slice/crio-c92fee8d0e55591f75bf1ea539a40482f5e875a8315f3d390f4625b94b56bdcb WatchSource:0}: Error finding container c92fee8d0e55591f75bf1ea539a40482f5e875a8315f3d390f4625b94b56bdcb: Status 404 returned error can't find the container with id c92fee8d0e55591f75bf1ea539a40482f5e875a8315f3d390f4625b94b56bdcb
Oct 30 20:55:55.987760 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:55.987736    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:55:56.286294 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:56.286262    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" event={"ID":"8cf18e1c-26b3-4ad5-908d-67523245519d","Type":"ContainerStarted","Data":"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"}
Oct 30 20:55:56.286515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:56.286312    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" event={"ID":"8cf18e1c-26b3-4ad5-908d-67523245519d","Type":"ContainerStarted","Data":"c92fee8d0e55591f75bf1ea539a40482f5e875a8315f3d390f4625b94b56bdcb"}
Oct 30 20:55:56.286515 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:56.286465    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:55:56.311534 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:56.311470    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" podStartSLOduration=1.3114507149999999 podStartE2EDuration="1.311450715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:56.30657111 +0000 UTC m=+1018.110465885" watchObservedRunningTime="2026-10-30 20:55:56.311450715 +0000 UTC m=+1018.115345473"
Oct 30 20:55:57.076750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.076716    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:55:57.081561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.081500    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.084929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.084873    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a8daf029-dockercfg-bgrxs\""
Oct 30 20:55:57.090364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.090341    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a8daf029\""
Oct 30 20:55:57.092049 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.092028    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:55:57.181246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.174984    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twxs\" (UniqueName: \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.181246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.175171    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.285474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.284049    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.285474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.284394    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twxs\" (UniqueName: \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.303548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.286248    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.305556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.304264    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twxs\" (UniqueName: \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\") pod \"payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.404091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.402781    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:57.751446 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:57.751408    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:55:57.751619 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:55:57.751505    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bddf22_1d94_4ec1_b910_2aa22bfc8e33.slice/crio-a3ff6b750bab5d7c982c4a6804a2363d99a752b1093ef244ef925770ab474578 WatchSource:0}: Error finding container a3ff6b750bab5d7c982c4a6804a2363d99a752b1093ef244ef925770ab474578: Status 404 returned error can't find the container with id a3ff6b750bab5d7c982c4a6804a2363d99a752b1093ef244ef925770ab474578
Oct 30 20:55:58.333364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:58.333326    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" event={"ID":"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33","Type":"ContainerStarted","Data":"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"}
Oct 30 20:55:58.333587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:58.333432    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" event={"ID":"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33","Type":"ContainerStarted","Data":"a3ff6b750bab5d7c982c4a6804a2363d99a752b1093ef244ef925770ab474578"}
Oct 30 20:55:58.333587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:58.333465    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:55:58.355979 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:55:58.355933    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" podStartSLOduration=1.355920397 podStartE2EDuration="1.355920397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:58.351889915 +0000 UTC m=+1020.155784689" watchObservedRunningTime="2026-10-30 20:55:58.355920397 +0000 UTC m=+1020.159815153"
Oct 30 20:56:00.415911 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.415876    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:00.420860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.420841    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.425573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.425545    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ab941206-serving-cert\""
Oct 30 20:56:00.433576 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.432769    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:00.546346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.546316    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.546607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.546584    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.546703 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.546630    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.546787 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.546771    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhmb\" (UniqueName: \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.648199 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.648167    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.648377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.648211    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.648377 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.648296    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhmb\" (UniqueName: \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.648540 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.648503    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.650341 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.650311    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.651997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.651971    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.653514 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.653492    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.661021 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.660986    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhmb\" (UniqueName: \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\") pod \"maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:00.738753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:00.738683    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:01.069556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:01.057130    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:01.366261 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:01.366175    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" event={"ID":"038c3619-01a5-4916-b40c-b70df8dc60cc","Type":"ContainerStarted","Data":"75f2175506903351d322df7f34b314cfbcccc6bfa947ced5d3e6193a8a64dfd6"}
Oct 30 20:56:02.376778 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:02.376735    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" event={"ID":"038c3619-01a5-4916-b40c-b70df8dc60cc","Type":"ContainerStarted","Data":"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"}
Oct 30 20:56:02.377330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:02.376914    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:02.399364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:02.399317    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" podStartSLOduration=1.963840649 podStartE2EDuration="2.399303486s" totalImagesPullingTime="435.462837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:02.395869642 +0000 UTC m=+1024.199764417" watchObservedRunningTime="2026-10-30 20:56:02.399303486 +0000 UTC m=+1024.203198269"
Oct 30 20:56:02.999546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:02.998978    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:56:03.005845 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.005797    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.015877 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.015851    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a8daf029-serving-cert\""
Oct 30 20:56:03.022790 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.022753    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:56:03.125562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.123216    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjsvm\" (UniqueName: \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.125562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.123334    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.125562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.123401    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.125562 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.123607    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.225624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.225590    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjsvm\" (UniqueName: \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.225795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.225693    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.225795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.225747    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.225957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.225942    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.226601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.226570    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.228926 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.228897    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.234215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.234183    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.236968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.236944    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjsvm\" (UniqueName: \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\") pod \"maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.337067 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.337032    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:03.622776 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:56:03.622748    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc13e56_bc30_4bec_9812_e2995df0ff03.slice/crio-41177e25b5d69f4619b61bcd3cc0b48600f2cda7072e54d2d034441822959cc9 WatchSource:0}: Error finding container 41177e25b5d69f4619b61bcd3cc0b48600f2cda7072e54d2d034441822959cc9: Status 404 returned error can't find the container with id 41177e25b5d69f4619b61bcd3cc0b48600f2cda7072e54d2d034441822959cc9
Oct 30 20:56:03.624055 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:03.624027    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:56:04.401491 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:04.401398    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" event={"ID":"8fc13e56-bc30-4bec-9812-e2995df0ff03","Type":"ContainerStarted","Data":"bcf332ac746aa7fba2036c4fb90007cc550778451917e7a4dff96df7a1e8d7cf"}
Oct 30 20:56:04.401491 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:04.401468    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" event={"ID":"8fc13e56-bc30-4bec-9812-e2995df0ff03","Type":"ContainerStarted","Data":"41177e25b5d69f4619b61bcd3cc0b48600f2cda7072e54d2d034441822959cc9"}
Oct 30 20:56:04.402418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:04.402206    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:04.422228 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:04.421334    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" podStartSLOduration=1.979743487 podStartE2EDuration="2.421316049s" totalImagesPullingTime="441.572562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:04.419979521 +0000 UTC m=+1026.223874310" watchObservedRunningTime="2026-10-30 20:56:04.421316049 +0000 UTC m=+1026.225210806"
Oct 30 20:56:06.283291 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:06.283248    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:56:07.326091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:07.326059    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:56:08.392706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:08.392678    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:09.344937 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:09.344910    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:56:10.429250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:10.426739    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:15.164546 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.164246    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:15.216548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.215569    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:15.395997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.394624    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 30 20:56:15.459760 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.459657    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:15.708327 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.708277    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:15.840565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:15.833617    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:16.409671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.409619    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:16.508824 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.473296    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:56:16.686602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.675145    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:56:16.686602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.675484    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:56:16.778552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.759668    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:56:16.778552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:16.760575    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:56:17.128552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.125190    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:56:17.148728 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.148674    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:17.687552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.564183    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:17.687552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.621098    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:56:17.687552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.669559    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:17.931564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:17.930268    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/model-serving-api-75bd89fdfc-r7zmp" podUID="359e3225-1a52-4746-a68a-27b68aa1c983" containerName="server" probeResult="failure" output="Get \"https://10.132.0.51:8443/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:18.369551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.344499    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:56:18.676367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.451255    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 20:56:18.792550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.766299    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:18.878574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.825835    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:56:18.878574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.833515    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r" podUID="6954dc2e-9cb9-4330-9281-bc63ce255bb9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:56:18.964719 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:18.964611    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4" podUID="6529e2bd-2ff0-473d-8bee-89ca41036578" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 20:56:19.210762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.208601    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/echo-simulator-kserve-64b6f8f96c-6mk6g" podUID="4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.59:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:19.262610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.249695    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-jmqjw" podUID="42072638-49f4-4d89-83db-694b8d828a1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 20:56:19.683865 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.683818    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:19.684505 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.684473    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": context deadline exceeded"
Oct 30 20:56:19.715739 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.715678    5115 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:19.766779 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:19.766744    5115 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.39s"
Oct 30 20:56:19.794663 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.794621    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:19.847650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:19.847601    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:20.773718 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:20.773669    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:20.777370 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:20.777329    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:20.842549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:20.831093    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:20.849962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:20.848675    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp" podUID="c7ebf960-5308-4e3b-99ff-488bc3311a13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:20.971581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:20.942208    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:56:21.020533 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:21.020482    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp"
Oct 30 20:56:21.047604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:21.036100    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 20:56:21.116074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:21.115604    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:56:28.429633 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.429594    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:28.435182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.435155    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.443374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.443335    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2e92a84c-serving-cert\""
Oct 30 20:56:28.446036 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.446014    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:28.611307 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.611275    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.611510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.611328    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.611631 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.611603    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65h85\" (UniqueName: \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.611777 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.611762    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.713732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.713641    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65h85\" (UniqueName: \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.713914 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.713789    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.713914 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.713888    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.714039 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.713948    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.714642 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.714610    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.717180 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.717156    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.717180 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.717167    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.725433 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.725405    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65h85\" (UniqueName: \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\") pod \"maas-api-e2e-ait-2e92a84c-687f44d775-vj749\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:28.778870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:28.778841    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:29.141159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:29.141119    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:29.940102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:29.940009    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" event={"ID":"8a857a19-ed98-4980-ad07-5c948a56dbc9","Type":"ContainerStarted","Data":"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"}
Oct 30 20:56:29.940102 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:29.940101    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:29.940503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:29.940119    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" event={"ID":"8a857a19-ed98-4980-ad07-5c948a56dbc9","Type":"ContainerStarted","Data":"cbbe0b6f48e9aa3aff1bfdef1f3bcf6b9337538e4e5445b918b67beaf5e3eeee"}
Oct 30 20:56:30.009741 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:30.009675    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" podStartSLOduration=1.583132873 podStartE2EDuration="2.009658661s" totalImagesPullingTime="426.525788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:30.001513558 +0000 UTC m=+1051.805408354" watchObservedRunningTime="2026-10-30 20:56:30.009658661 +0000 UTC m=+1051.813553419"
Oct 30 20:56:35.110300 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:35.110262    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:56:35.962001 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:35.961971    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:36.282818 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:36.282776    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:56:40.014045 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.014012    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:40.014587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.014209    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" podUID="038c3619-01a5-4916-b40c-b70df8dc60cc" containerName="maas-api" containerID="cri-o://eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24" gracePeriod=30
Oct 30 20:56:40.111455 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.111411    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" podUID="8cf18e1c-26b3-4ad5-908d-67523245519d" containerName="payload-processing" containerID="cri-o://77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1" gracePeriod=25
Oct 30 20:56:40.685772 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.685634    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:40.720060 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.720027    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\") pod \"038c3619-01a5-4916-b40c-b70df8dc60cc\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") "
Oct 30 20:56:40.720213 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.720124    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\" (UniqueName: \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\") pod \"038c3619-01a5-4916-b40c-b70df8dc60cc\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") "
Oct 30 20:56:40.720363 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.720346    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\") pod \"038c3619-01a5-4916-b40c-b70df8dc60cc\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") "
Oct 30 20:56:40.720513 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.720498    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\") pod \"038c3619-01a5-4916-b40c-b70df8dc60cc\" (UID: \"038c3619-01a5-4916-b40c-b70df8dc60cc\") "
Oct 30 20:56:40.723310 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.723281    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca" pod "038c3619-01a5-4916-b40c-b70df8dc60cc" (UID: "038c3619-01a5-4916-b40c-b70df8dc60cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:40.726043 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.726006    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb" pod "038c3619-01a5-4916-b40c-b70df8dc60cc" (UID: "038c3619-01a5-4916-b40c-b70df8dc60cc"). InnerVolumeSpecName "kube-api-access-kdhmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:40.727085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.727060    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs" pod "038c3619-01a5-4916-b40c-b70df8dc60cc" (UID: "038c3619-01a5-4916-b40c-b70df8dc60cc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:40.730405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.730382    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls" pod "038c3619-01a5-4916-b40c-b70df8dc60cc" (UID: "038c3619-01a5-4916-b40c-b70df8dc60cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:40.740919 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.740882    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.826312    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\" (UniqueName: \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\") pod \"8cf18e1c-26b3-4ad5-908d-67523245519d\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") "
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.826399    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\") pod \"8cf18e1c-26b3-4ad5-908d-67523245519d\" (UID: \"8cf18e1c-26b3-4ad5-908d-67523245519d\") "
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.827509    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.830201    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume" pod "8cf18e1c-26b3-4ad5-908d-67523245519d" (UID: "8cf18e1c-26b3-4ad5-908d-67523245519d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.830428    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/038c3619-01a5-4916-b40c-b70df8dc60cc-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.830454    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/038c3619-01a5-4916-b40c-b70df8dc60cc-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:40.838656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.830469    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdhmb\" (UniqueName: \"kubernetes.io/projected/038c3619-01a5-4916-b40c-b70df8dc60cc-kube-api-access-kdhmb\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:40.846112 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.846074    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx" pod "8cf18e1c-26b3-4ad5-908d-67523245519d" (UID: "8cf18e1c-26b3-4ad5-908d-67523245519d"). InnerVolumeSpecName "kube-api-access-klpwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:40.932034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.931937    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klpwx\" (UniqueName: \"kubernetes.io/projected/8cf18e1c-26b3-4ad5-908d-67523245519d-kube-api-access-klpwx\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:40.932034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:40.932035    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cf18e1c-26b3-4ad5-908d-67523245519d-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:41.066836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.066800    5115 generic.go:356] "Generic (PLEG): container finished" podID="8cf18e1c-26b3-4ad5-908d-67523245519d" containerID="77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1" exitCode=0
Oct 30 20:56:41.067255 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.066845    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"
Oct 30 20:56:41.067255 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.066878    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" event={"ID":"8cf18e1c-26b3-4ad5-908d-67523245519d","Type":"ContainerDied","Data":"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"}
Oct 30 20:56:41.067255 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.066935    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x" event={"ID":"8cf18e1c-26b3-4ad5-908d-67523245519d","Type":"ContainerDied","Data":"c92fee8d0e55591f75bf1ea539a40482f5e875a8315f3d390f4625b94b56bdcb"}
Oct 30 20:56:41.067255 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.066963    5115 scope.go:122] "RemoveContainer" containerID="77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"
Oct 30 20:56:41.068943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.068917    5115 generic.go:356] "Generic (PLEG): container finished" podID="038c3619-01a5-4916-b40c-b70df8dc60cc" containerID="eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24" exitCode=0
Oct 30 20:56:41.069135 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.069113    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" event={"ID":"038c3619-01a5-4916-b40c-b70df8dc60cc","Type":"ContainerDied","Data":"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"}
Oct 30 20:56:41.069241 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.069155    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d" event={"ID":"038c3619-01a5-4916-b40c-b70df8dc60cc","Type":"ContainerDied","Data":"75f2175506903351d322df7f34b314cfbcccc6bfa947ced5d3e6193a8a64dfd6"}
Oct 30 20:56:41.069241 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.069216    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"
Oct 30 20:56:41.086019 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.085983    5115 scope.go:122] "RemoveContainer" containerID="77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"
Oct 30 20:56:41.087777 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:41.087742    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1\": container with ID starting with 77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1 not found: ID does not exist" containerID="77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"
Oct 30 20:56:41.087957 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.087931    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1"} err="failed to get container status \"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1\": rpc error: code = NotFound desc = could not find container \"77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1\": container with ID starting with 77fc18adc15d55a29c70c1d8841f1920b2b2636f06a96262a366eeb80bed10e1 not found: ID does not exist"
Oct 30 20:56:41.088086 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.087960    5115 scope.go:122] "RemoveContainer" containerID="eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"
Oct 30 20:56:41.112158 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.112129    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:41.124582 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.121733    5115 scope.go:122] "RemoveContainer" containerID="eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"
Oct 30 20:56:41.126578 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:41.125935    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24\": container with ID starting with eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24 not found: ID does not exist" containerID="eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"
Oct 30 20:56:41.126578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.125975    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24"} err="failed to get container status \"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24\": rpc error: code = NotFound desc = could not find container \"eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24\": container with ID starting with eae94702d4adcac9ee9fd0e4d981b72ee1b29bb258e4c276a1e0eb2424138b24 not found: ID does not exist"
Oct 30 20:56:41.130805 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.130582    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab941206-fb88f8b8b-fgp6d"]
Oct 30 20:56:41.139094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.139068    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:56:41.156107 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:41.156077    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ab941206-689d64fc8d-rhb9x"]
Oct 30 20:56:42.371190 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:42.371154    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="038c3619-01a5-4916-b40c-b70df8dc60cc" path="/var/lib/kubelet/pods/038c3619-01a5-4916-b40c-b70df8dc60cc/volumes"
Oct 30 20:56:42.371685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:42.371669    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cf18e1c-26b3-4ad5-908d-67523245519d" path="/var/lib/kubelet/pods/8cf18e1c-26b3-4ad5-908d-67523245519d/volumes"
Oct 30 20:56:46.994549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:46.994403    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7100-489caf"]
Oct 30 20:56:46.995069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:46.994668    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7100-489caf" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" containerName="test-curl-7100-489caf" containerID="cri-o://e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195" gracePeriod=2
Oct 30 20:56:47.008581 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:47.007674    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:47.017549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.017431    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7100-489caf"]
Oct 30 20:56:47.221953 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.221915    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7100-2bba7e"]
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224137    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" containerName="test-curl-7100-489caf"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224165    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" containerName="test-curl-7100-489caf"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224243    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8cf18e1c-26b3-4ad5-908d-67523245519d" containerName="payload-processing"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224252    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8cf18e1c-26b3-4ad5-908d-67523245519d" containerName="payload-processing"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224267    5115 cpu_manager.go:414] "containerMap: removing container" podUID="038c3619-01a5-4916-b40c-b70df8dc60cc" containerName="maas-api"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224274    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="038c3619-01a5-4916-b40c-b70df8dc60cc" containerName="maas-api"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224473    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" containerName="test-curl-7100-489caf"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224501    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="8cf18e1c-26b3-4ad5-908d-67523245519d" containerName="payload-processing"
Oct 30 20:56:47.230552 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.224510    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="038c3619-01a5-4916-b40c-b70df8dc60cc" containerName="maas-api"
Oct 30 20:56:47.278463 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.278429    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:47.434692 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.423278    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxrg2\" (UniqueName: \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\") pod \"test-curl-7100-2bba7e\" (UID: \"c6288871-3657-4d4d-b5ca-0253abfb97d3\") " pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:47.438556 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:47.437910    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:47.512726 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.505868    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7100-2bba7e"]
Oct 30 20:56:47.554604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.549708    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxrg2\" (UniqueName: \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\") pod \"test-curl-7100-2bba7e\" (UID: \"c6288871-3657-4d4d-b5ca-0253abfb97d3\") " pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:47.584597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.583774    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxrg2\" (UniqueName: \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\") pod \"test-curl-7100-2bba7e\" (UID: \"c6288871-3657-4d4d-b5ca-0253abfb97d3\") " pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:47.817658 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:47.816118    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:48.160547 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:48.160497    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7100-2bba7e"]
Oct 30 20:56:48.161384 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:56:48.161354    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6288871_3657_4d4d_b5ca_0253abfb97d3.slice/crio-4a2ce18575f546ac4930af6dc8aff603045659d67d690bc70a61516d7619bd07 WatchSource:0}: Error finding container 4a2ce18575f546ac4930af6dc8aff603045659d67d690bc70a61516d7619bd07: Status 404 returned error can't find the container with id 4a2ce18575f546ac4930af6dc8aff603045659d67d690bc70a61516d7619bd07
Oct 30 20:56:48.288267 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:48.288236    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7100-2bba7e" event={"ID":"c6288871-3657-4d4d-b5ca-0253abfb97d3","Type":"ContainerStarted","Data":"0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8"}
Oct 30 20:56:48.288450 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:48.288278    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7100-2bba7e" event={"ID":"c6288871-3657-4d4d-b5ca-0253abfb97d3","Type":"ContainerStarted","Data":"4a2ce18575f546ac4930af6dc8aff603045659d67d690bc70a61516d7619bd07"}
Oct 30 20:56:48.303284 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:48.303242    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:48.307076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:48.307021    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7100-2bba7e" podStartSLOduration=1.3070022049999999 podStartE2EDuration="1.307002205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:48.301735297 +0000 UTC m=+1070.105630079" watchObservedRunningTime="2026-10-30 20:56:48.307002205 +0000 UTC m=+1070.110896964"
Oct 30 20:56:48.374076 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:48.374022    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:49.250070 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.250037    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7100-2bba7e"]
Oct 30 20:56:49.257051 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.257020    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7100-2bba7e"]
Oct 30 20:56:49.264037 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.264006    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:49.298426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.298332    5115 generic.go:356] "Generic (PLEG): container finished" podID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" containerID="e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195" exitCode=137
Oct 30 20:56:49.298426 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.298392    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:49.298701 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.298456    5115 scope.go:122] "RemoveContainer" containerID="e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195"
Oct 30 20:56:49.312726 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.312710    5115 scope.go:122] "RemoveContainer" containerID="e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195"
Oct 30 20:56:49.313005 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:49.312983    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195\": container with ID starting with e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195 not found: ID does not exist" containerID="e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195"
Oct 30 20:56:49.313073 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.313012    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195"} err="failed to get container status \"e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195\": rpc error: code = NotFound desc = could not find container \"e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195\": container with ID starting with e938dd70436bc7df721d213d7a98fb273a462a3202a079df7d70ab2fb9d14195 not found: ID does not exist"
Oct 30 20:56:49.416507 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.416477    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\" (UniqueName: \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\") pod \"ff6368c8-4353-4ffa-9fca-371f3b178bb0\" (UID: \"ff6368c8-4353-4ffa-9fca-371f3b178bb0\") "
Oct 30 20:56:49.418603 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.418574    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx" pod "ff6368c8-4353-4ffa-9fca-371f3b178bb0" (UID: "ff6368c8-4353-4ffa-9fca-371f3b178bb0"). InnerVolumeSpecName "kube-api-access-2zvfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:49.518133 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:49.518097    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zvfx\" (UniqueName: \"kubernetes.io/projected/ff6368c8-4353-4ffa-9fca-371f3b178bb0-kube-api-access-2zvfx\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:49.610177 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:49.610143    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:50.307831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:50.307795    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7100-2bba7e" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" containerName="test-curl-7100-2bba7e" containerID="cri-o://0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8" gracePeriod=2
Oct 30 20:56:50.311729 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:50.311700    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-489caf\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" pod="opendatahub/test-curl-7100-489caf"
Oct 30 20:56:50.313392 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:50.313368    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-2bba7e\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:50.373027 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:50.372992    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff6368c8-4353-4ffa-9fca-371f3b178bb0" path="/var/lib/kubelet/pods/ff6368c8-4353-4ffa-9fca-371f3b178bb0/volumes"
Oct 30 20:56:52.510617 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:52.508986    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:56:52.612991 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:52.612921    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:52.683107 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:52.683075    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\" (UniqueName: \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\") pod \"c6288871-3657-4d4d-b5ca-0253abfb97d3\" (UID: \"c6288871-3657-4d4d-b5ca-0253abfb97d3\") "
Oct 30 20:56:52.687504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:52.687472    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2" pod "c6288871-3657-4d4d-b5ca-0253abfb97d3" (UID: "c6288871-3657-4d4d-b5ca-0253abfb97d3"). InnerVolumeSpecName "kube-api-access-gxrg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:52.837367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:52.829715    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxrg2\" (UniqueName: \"kubernetes.io/projected/c6288871-3657-4d4d-b5ca-0253abfb97d3-kube-api-access-gxrg2\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:53.362249 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.362212    5115 generic.go:356] "Generic (PLEG): container finished" podID="c6288871-3657-4d4d-b5ca-0253abfb97d3" containerID="0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8" exitCode=137
Oct 30 20:56:53.362441 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.362258    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:53.362441 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.362300    5115 scope.go:122] "RemoveContainer" containerID="0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8"
Oct 30 20:56:53.373738 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:53.373709    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-2bba7e\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:53.374110 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.374093    5115 scope.go:122] "RemoveContainer" containerID="0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8"
Oct 30 20:56:53.374367 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:53.374342    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8\": container with ID starting with 0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8 not found: ID does not exist" containerID="0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8"
Oct 30 20:56:53.374427 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.374370    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8"} err="failed to get container status \"0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8\": rpc error: code = NotFound desc = could not find container \"0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8\": container with ID starting with 0de8d8cc52bc50e8b8f044933500e7a0f156959b523e3e4638a2d9cbea1305f8 not found: ID does not exist"
Oct 30 20:56:53.776797 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.776754    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:53.777187 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:53.777012    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" podUID="8a857a19-ed98-4980-ad07-5c948a56dbc9" containerName="maas-api" containerID="cri-o://700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb" gracePeriod=30
Oct 30 20:56:53.779000 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:53.778955    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-2bba7e\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:54.264114 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.264081    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:54.266029 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:54.265822    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-2bba7e\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:54.373984 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.373947    5115 generic.go:356] "Generic (PLEG): container finished" podID="8a857a19-ed98-4980-ad07-5c948a56dbc9" containerID="700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb" exitCode=0
Oct 30 20:56:54.374178 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.374078    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"
Oct 30 20:56:54.375309 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.375282    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" path="/var/lib/kubelet/pods/c6288871-3657-4d4d-b5ca-0253abfb97d3/volumes"
Oct 30 20:56:54.377679 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.377657    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" event={"ID":"8a857a19-ed98-4980-ad07-5c948a56dbc9","Type":"ContainerDied","Data":"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"}
Oct 30 20:56:54.377767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.377709    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749" event={"ID":"8a857a19-ed98-4980-ad07-5c948a56dbc9","Type":"ContainerDied","Data":"cbbe0b6f48e9aa3aff1bfdef1f3bcf6b9337538e4e5445b918b67beaf5e3eeee"}
Oct 30 20:56:54.377767 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.377742    5115 scope.go:122] "RemoveContainer" containerID="700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"
Oct 30 20:56:54.379840 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:54.379809    5115 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7100-2bba7e\" is forbidden: User \"system:node:ip-10-0-135-104.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-104.us-east-2.compute.internal' and this object" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" pod="opendatahub/test-curl-7100-2bba7e"
Oct 30 20:56:54.384906 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.384884    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\" (UniqueName: \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\") pod \"8a857a19-ed98-4980-ad07-5c948a56dbc9\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") "
Oct 30 20:56:54.384998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.384923    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\") pod \"8a857a19-ed98-4980-ad07-5c948a56dbc9\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") "
Oct 30 20:56:54.384998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.384961    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\") pod \"8a857a19-ed98-4980-ad07-5c948a56dbc9\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") "
Oct 30 20:56:54.384998 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.384987    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\") pod \"8a857a19-ed98-4980-ad07-5c948a56dbc9\" (UID: \"8a857a19-ed98-4980-ad07-5c948a56dbc9\") "
Oct 30 20:56:54.385610 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.385585    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca" pod "8a857a19-ed98-4980-ad07-5c948a56dbc9" (UID: "8a857a19-ed98-4980-ad07-5c948a56dbc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:54.385770 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.385753    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a857a19-ed98-4980-ad07-5c948a56dbc9-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:54.388004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.387977    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls" pod "8a857a19-ed98-4980-ad07-5c948a56dbc9" (UID: "8a857a19-ed98-4980-ad07-5c948a56dbc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:54.389204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.389178    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85" pod "8a857a19-ed98-4980-ad07-5c948a56dbc9" (UID: "8a857a19-ed98-4980-ad07-5c948a56dbc9"). InnerVolumeSpecName "kube-api-access-65h85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:54.392586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.389872    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs" pod "8a857a19-ed98-4980-ad07-5c948a56dbc9" (UID: "8a857a19-ed98-4980-ad07-5c948a56dbc9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:54.392586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.390891    5115 scope.go:122] "RemoveContainer" containerID="700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"
Oct 30 20:56:54.392586 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:54.391169    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb\": container with ID starting with 700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb not found: ID does not exist" containerID="700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"
Oct 30 20:56:54.392586 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.391191    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb"} err="failed to get container status \"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb\": rpc error: code = NotFound desc = could not find container \"700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb\": container with ID starting with 700c4984b60981accf49085c08fe2b71f81ee208fac7cd13f6daff208403cbfb not found: ID does not exist"
Oct 30 20:56:54.451909 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.451710    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:56:54.488082 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.487988    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65h85\" (UniqueName: \"kubernetes.io/projected/8a857a19-ed98-4980-ad07-5c948a56dbc9-kube-api-access-65h85\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:54.488082 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.488024    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:54.488082 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.488042    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a857a19-ed98-4980-ad07-5c948a56dbc9-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:54.706274 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.706242    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:54.713433 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:54.713399    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e92a84c-687f44d775-vj749"]
Oct 30 20:56:56.371639 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:56.371601    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a857a19-ed98-4980-ad07-5c948a56dbc9" path="/var/lib/kubelet/pods/8a857a19-ed98-4980-ad07-5c948a56dbc9/volumes"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.447576    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.448893    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8a857a19-ed98-4980-ad07-5c948a56dbc9" containerName="maas-api"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.448913    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a857a19-ed98-4980-ad07-5c948a56dbc9" containerName="maas-api"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.448954    5115 cpu_manager.go:414] "containerMap: removing container" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" containerName="test-curl-7100-2bba7e"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.448962    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" containerName="test-curl-7100-2bba7e"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.449119    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a857a19-ed98-4980-ad07-5c948a56dbc9" containerName="maas-api"
Oct 30 20:56:57.450558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.449137    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6288871-3657-4d4d-b5ca-0253abfb97d3" containerName="test-curl-7100-2bba7e"
Oct 30 20:56:57.455398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.455376    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:56:57.455503 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.455489    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.459332 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.459308    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a4317e67\""
Oct 30 20:56:57.460403 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.460385    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.478674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.477456    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:56:57.484064 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.484036    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:56:57.491421 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.491392    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7btw\" (UniqueName: \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.491607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.491560    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xml48\" (UniqueName: \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.491787 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.491764    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.491961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.491945    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.510626 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.510595    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" podUID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" containerName="payload-pre-processing" containerID="cri-o://62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162" gracePeriod=25
Oct 30 20:56:57.593111 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.593077    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7btw\" (UniqueName: \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.593292 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.593181    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xml48\" (UniqueName: \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.593360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.593325    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.593485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.593465    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.594113 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.594088    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.594204 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.594190    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.604650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.604618    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7btw\" (UniqueName: \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\") pod \"payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.605399 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.605374    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xml48\" (UniqueName: \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\") pod \"payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") " pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.803649 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.778430    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:57.803649 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.787475    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:57.957596 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:57.957472    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:56:58.049776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.043894    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\") pod \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") "
Oct 30 20:56:58.049776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.043950    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\" (UniqueName: \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\") pod \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\" (UID: \"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33\") "
Oct 30 20:56:58.049776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.045499    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume" pod "a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" (UID: "a7bddf22-1d94-4ec1-b910-2aa22bfc8e33"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:58.049776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.045906    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:58.051438 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.051388    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs" pod "a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" (UID: "a7bddf22-1d94-4ec1-b910-2aa22bfc8e33"). InnerVolumeSpecName "kube-api-access-2twxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:58.147543 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.147490    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2twxs\" (UniqueName: \"kubernetes.io/projected/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33-kube-api-access-2twxs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:58.177708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.177672    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:56:58.177991 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.177965    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" podUID="8fc13e56-bc30-4bec-9812-e2995df0ff03" containerName="maas-api" containerID="cri-o://bcf332ac746aa7fba2036c4fb90007cc550778451917e7a4dff96df7a1e8d7cf" gracePeriod=30
Oct 30 20:56:58.251210 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:56:58.251178    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf207df28_a990_463e_861e_dc92b44c02a5.slice/crio-5abc31d55338a9890cbe3de8444be2c1ab0988f6a0d61a2c2ef559c140ec0e13 WatchSource:0}: Error finding container 5abc31d55338a9890cbe3de8444be2c1ab0988f6a0d61a2c2ef559c140ec0e13: Status 404 returned error can't find the container with id 5abc31d55338a9890cbe3de8444be2c1ab0988f6a0d61a2c2ef559c140ec0e13
Oct 30 20:56:58.253462 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.253430    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:56:58.257020 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:56:58.256994    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c37318_59d8_41f0_ad68_14f3dea42f87.slice/crio-01787658f248acdeebf8f46b769271f0a08bf34e8651e2c5f6856625b9e0c48e WatchSource:0}: Error finding container 01787658f248acdeebf8f46b769271f0a08bf34e8651e2c5f6856625b9e0c48e: Status 404 returned error can't find the container with id 01787658f248acdeebf8f46b769271f0a08bf34e8651e2c5f6856625b9e0c48e
Oct 30 20:56:58.258479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.258458    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:56:58.575712 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.575678    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" event={"ID":"f3c37318-59d8-41f0-ad68-14f3dea42f87","Type":"ContainerStarted","Data":"01787658f248acdeebf8f46b769271f0a08bf34e8651e2c5f6856625b9e0c48e"}
Oct 30 20:56:58.581376 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.581348    5115 generic.go:356] "Generic (PLEG): container finished" podID="8fc13e56-bc30-4bec-9812-e2995df0ff03" containerID="bcf332ac746aa7fba2036c4fb90007cc550778451917e7a4dff96df7a1e8d7cf" exitCode=0
Oct 30 20:56:58.581500 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.581447    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" event={"ID":"8fc13e56-bc30-4bec-9812-e2995df0ff03","Type":"ContainerDied","Data":"bcf332ac746aa7fba2036c4fb90007cc550778451917e7a4dff96df7a1e8d7cf"}
Oct 30 20:56:58.585709 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.583613    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" event={"ID":"f207df28-a990-463e-861e-dc92b44c02a5","Type":"ContainerStarted","Data":"5abc31d55338a9890cbe3de8444be2c1ab0988f6a0d61a2c2ef559c140ec0e13"}
Oct 30 20:56:58.586899 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.586877    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:56:58.593652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.589388    5115 generic.go:356] "Generic (PLEG): container finished" podID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" containerID="62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162" exitCode=0
Oct 30 20:56:58.593652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.589477    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"
Oct 30 20:56:58.593652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.589485    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" event={"ID":"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33","Type":"ContainerDied","Data":"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"}
Oct 30 20:56:58.593652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.589540    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m" event={"ID":"a7bddf22-1d94-4ec1-b910-2aa22bfc8e33","Type":"ContainerDied","Data":"a3ff6b750bab5d7c982c4a6804a2363d99a752b1093ef244ef925770ab474578"}
Oct 30 20:56:58.593652 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.589569    5115 scope.go:122] "RemoveContainer" containerID="62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"
Oct 30 20:56:58.613962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.613571    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" podStartSLOduration=1.6135508710000002 podStartE2EDuration="1.613550871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:58.610265745 +0000 UTC m=+1080.414160502" watchObservedRunningTime="2026-10-30 20:56:58.613550871 +0000 UTC m=+1080.417445627"
Oct 30 20:56:58.648185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.648156    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:58.660900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.660848    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:56:58.669581 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.668030    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a8daf029-7584fcdd6c-tsd4m"]
Oct 30 20:56:58.669814 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.668428    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\") pod \"8fc13e56-bc30-4bec-9812-e2995df0ff03\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") "
Oct 30 20:56:58.670068 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.670046    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\") pod \"8fc13e56-bc30-4bec-9812-e2995df0ff03\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") "
Oct 30 20:56:58.674671 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.670276    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\") pod \"8fc13e56-bc30-4bec-9812-e2995df0ff03\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") "
Oct 30 20:56:58.675005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.674984    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\" (UniqueName: \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\") pod \"8fc13e56-bc30-4bec-9812-e2995df0ff03\" (UID: \"8fc13e56-bc30-4bec-9812-e2995df0ff03\") "
Oct 30 20:56:58.700763 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.668813    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca" pod "8fc13e56-bc30-4bec-9812-e2995df0ff03" (UID: "8fc13e56-bc30-4bec-9812-e2995df0ff03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:58.700763 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.692373    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm" pod "8fc13e56-bc30-4bec-9812-e2995df0ff03" (UID: "8fc13e56-bc30-4bec-9812-e2995df0ff03"). InnerVolumeSpecName "kube-api-access-rjsvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:58.701669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.701621    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs" pod "8fc13e56-bc30-4bec-9812-e2995df0ff03" (UID: "8fc13e56-bc30-4bec-9812-e2995df0ff03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:58.724238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.723913    5115 scope.go:122] "RemoveContainer" containerID="62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"
Oct 30 20:56:58.748722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.748689    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls" pod "8fc13e56-bc30-4bec-9812-e2995df0ff03" (UID: "8fc13e56-bc30-4bec-9812-e2995df0ff03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:58.752788 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:56:58.750787    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162\": container with ID starting with 62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162 not found: ID does not exist" containerID="62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"
Oct 30 20:56:58.752788 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.750834    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162"} err="failed to get container status \"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162\": rpc error: code = NotFound desc = could not find container \"62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162\": container with ID starting with 62073aa5f4e5e6073af597959eebb85621c1d5e71bb04ed20089f112415c3162 not found: ID does not exist"
Oct 30 20:56:58.805597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.789958    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc13e56-bc30-4bec-9812-e2995df0ff03-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:58.805597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.789996    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:58.805597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.790013    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fc13e56-bc30-4bec-9812-e2995df0ff03-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:58.805597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:58.790027    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjsvm\" (UniqueName: \"kubernetes.io/projected/8fc13e56-bc30-4bec-9812-e2995df0ff03-kube-api-access-rjsvm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:59.607870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.607827    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" event={"ID":"f3c37318-59d8-41f0-ad68-14f3dea42f87","Type":"ContainerStarted","Data":"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"}
Oct 30 20:56:59.608700 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.608668    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:56:59.612290 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.611758    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp" event={"ID":"8fc13e56-bc30-4bec-9812-e2995df0ff03","Type":"ContainerDied","Data":"41177e25b5d69f4619b61bcd3cc0b48600f2cda7072e54d2d034441822959cc9"}
Oct 30 20:56:59.612290 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.611820    5115 scope.go:122] "RemoveContainer" containerID="bcf332ac746aa7fba2036c4fb90007cc550778451917e7a4dff96df7a1e8d7cf"
Oct 30 20:56:59.612290 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.611979    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"
Oct 30 20:56:59.614733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.614706    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" event={"ID":"f207df28-a990-463e-861e-dc92b44c02a5","Type":"ContainerStarted","Data":"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"}
Oct 30 20:56:59.632817 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.632728    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" podStartSLOduration=2.632708248 podStartE2EDuration="2.632708248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:59.629752131 +0000 UTC m=+1081.433646923" watchObservedRunningTime="2026-10-30 20:56:59.632708248 +0000 UTC m=+1081.436603007"
Oct 30 20:56:59.653342 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.653310    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:56:59.658061 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:56:59.658033    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8daf029-cb4d9948d-4vrfp"]
Oct 30 20:57:00.373437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:00.373400    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fc13e56-bc30-4bec-9812-e2995df0ff03" path="/var/lib/kubelet/pods/8fc13e56-bc30-4bec-9812-e2995df0ff03/volumes"
Oct 30 20:57:00.373933 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:00.373917    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" path="/var/lib/kubelet/pods/a7bddf22-1d94-4ec1-b910-2aa22bfc8e33/volumes"
Oct 30 20:57:02.190361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.190319    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:02.191146 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191127    5115 cpu_manager.go:414] "containerMap: removing container" podUID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" containerName="payload-pre-processing"
Oct 30 20:57:02.191146 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191145    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" containerName="payload-pre-processing"
Oct 30 20:57:02.191339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191187    5115 cpu_manager.go:414] "containerMap: removing container" podUID="8fc13e56-bc30-4bec-9812-e2995df0ff03" containerName="maas-api"
Oct 30 20:57:02.191339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191193    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fc13e56-bc30-4bec-9812-e2995df0ff03" containerName="maas-api"
Oct 30 20:57:02.191339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191320    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fc13e56-bc30-4bec-9812-e2995df0ff03" containerName="maas-api"
Oct 30 20:57:02.191339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.191335    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7bddf22-1d94-4ec1-b910-2aa22bfc8e33" containerName="payload-pre-processing"
Oct 30 20:57:02.197253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.197215    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.220776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.220731    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:02.222885 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.221506    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a4317e67-serving-cert\""
Oct 30 20:57:02.230601 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.230571    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.230892 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.230868    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.230983 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.230943    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77kk\" (UniqueName: \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.231196 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.231054    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.332360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.332318    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.332556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.332514    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.332685 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.332670    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.332815 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.332733    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77kk\" (UniqueName: \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.333211 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.333184    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.335246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.335224    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.335340 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.335245    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.344625 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.344598    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77kk\" (UniqueName: \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\") pod \"maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.532780 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.532737    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:02.873040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:02.873012    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:03.662172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:03.662065    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" event={"ID":"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0","Type":"ContainerStarted","Data":"74c4cd925622599e0dfa75fd91db91899c6359cae09a11a2a4ee6a087811da25"}
Oct 30 20:57:03.662172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:03.662134    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" event={"ID":"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0","Type":"ContainerStarted","Data":"95b954d62a6d7b9a1dc9f2d555fc8f6622657d43f5f9fd15e336b39735567279"}
Oct 30 20:57:03.662172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:03.662161    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:03.732001 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:03.731931    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" podStartSLOduration=1.325235141 podStartE2EDuration="1.731909193s" totalImagesPullingTime="406.674052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:03.727606051 +0000 UTC m=+1085.531500808" watchObservedRunningTime="2026-10-30 20:57:03.731909193 +0000 UTC m=+1085.535803961"
Oct 30 20:57:06.290244 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:06.290201    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:57:09.476288 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.476220    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" containerID="cri-o://46d88276acca436e0bbcf76e0cc2367f1edc3b280b124ea4bd8320508d1f56ec" gracePeriod=45
Oct 30 20:57:09.681942 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.680953    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:09.762629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.759538    5115 generic.go:356] "Generic (PLEG): container finished" podID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerID="46d88276acca436e0bbcf76e0cc2367f1edc3b280b124ea4bd8320508d1f56ec" exitCode=0
Oct 30 20:57:09.762629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.759698    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" event={"ID":"c5e55395-8ed8-4393-8871-1b54a5efdc0b","Type":"ContainerDied","Data":"46d88276acca436e0bbcf76e0cc2367f1edc3b280b124ea4bd8320508d1f56ec"}
Oct 30 20:57:09.871759 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.871731    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:57:09.874335 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.874305    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:57:09.905597 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.897254    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:57:09.956706 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.956668    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.956910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.956764    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\" (UniqueName: \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.956910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.956820    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.956910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.956907    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.957175 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.957153    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.957269 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.957251    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\") pod \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\" (UID: \"c5e55395-8ed8-4393-8871-1b54a5efdc0b\") "
Oct 30 20:57:09.959402 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.958369    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.959402 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.958587    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.959693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.959669    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.962579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.962492    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:09.963166 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.963129    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "kube-api-access-nc58m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.963770 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:09.963708    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm" pod "c5e55395-8ed8-4393-8871-1b54a5efdc0b" (UID: "c5e55395-8ed8-4393-8871-1b54a5efdc0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061308    5115 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-home\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061341    5115 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-model-cache\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061359    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc58m\" (UniqueName: \"kubernetes.io/projected/c5e55395-8ed8-4393-8871-1b54a5efdc0b-kube-api-access-nc58m\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061377    5115 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-dshm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061392    5115 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tmp-dir\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.061657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.061407    5115 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e55395-8ed8-4393-8871-1b54a5efdc0b-tls-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:10.630837 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.630809    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:57:10.631266 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.630897    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:57:10.769727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.769695    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"
Oct 30 20:57:10.769727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.769706    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" event={"ID":"c5e55395-8ed8-4393-8871-1b54a5efdc0b","Type":"ContainerDied","Data":"25592ea1fd15dcfccb395cb284a24df0aae30f7bde116fef8d7cf7b2e83258ce"}
Oct 30 20:57:10.769977 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.769761    5115 scope.go:122] "RemoveContainer" containerID="46d88276acca436e0bbcf76e0cc2367f1edc3b280b124ea4bd8320508d1f56ec"
Oct 30 20:57:10.774990 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.774957    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.88:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:57:10.802598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.799989    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:57:10.805604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:10.805570    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-db534b/distinct-w2-db534b-kserve-5b65795899-7mcbq"]
Oct 30 20:57:12.373717 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:12.373672    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" path="/var/lib/kubelet/pods/c5e55395-8ed8-4393-8871-1b54a5efdc0b/volumes"
Oct 30 20:57:14.261360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.261321    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:14.262238 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.262219    5115 cpu_manager.go:414] "containerMap: removing container" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main"
Oct 30 20:57:14.262285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.262240    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main"
Oct 30 20:57:14.262373 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.262364    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5e55395-8ed8-4393-8871-1b54a5efdc0b" containerName="main"
Oct 30 20:57:14.267418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.267394    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.284237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.284214    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qnz\" (UniqueName: \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.284358 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.284258    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.288801 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.288782    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-8d0462d9\""
Oct 30 20:57:14.296822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.296795    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:14.338022 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.337978    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:14.343123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.343098    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.355999 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.355978    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-8d0462d9-dockercfg-hhcnd\""
Oct 30 20:57:14.375313 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.375285    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:14.385466 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.385440    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qnz\" (UniqueName: \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.385623 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.385493    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.385754 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.385730    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.385848 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.385831    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt7cf\" (UniqueName: \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.386403 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.386384    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.453549 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.438272    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qnz\" (UniqueName: \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\") pod \"payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.508550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.498846    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.508550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.498946    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt7cf\" (UniqueName: \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.508550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.504827    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.569551 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.569451    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt7cf\" (UniqueName: \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\") pod \"payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") " pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.581569 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.581239    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:14.661838 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.661633    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:14.876172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.876067    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing" containerID="cri-o://58e1ea50f1740701f741f779368c9d1fb25566f8e3778ab24665ac1668866d6d" gracePeriod=25
Oct 30 20:57:14.898217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.898179    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing" containerID="cri-o://37312ab56f9c3cdee012d48a0d30bc2f0983f0eccd869b5fbc42bd67f7b1ccee" gracePeriod=25
Oct 30 20:57:14.910034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.910004    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:14.983692 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:14.983664    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:14.989094 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:57:14.989067    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d92a51_020a_48c1_85be_ef8b06d9ad36.slice/crio-1923cc2ce694752e401b6f697170a10e980b0dbecf82b7f839b38dd9b7de0efc WatchSource:0}: Error finding container 1923cc2ce694752e401b6f697170a10e980b0dbecf82b7f839b38dd9b7de0efc: Status 404 returned error can't find the container with id 1923cc2ce694752e401b6f697170a10e980b0dbecf82b7f839b38dd9b7de0efc
Oct 30 20:57:15.150274 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.150186    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:57:15.833311 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.833273    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" event={"ID":"36d92a51-020a-48c1-85be-ef8b06d9ad36","Type":"ContainerStarted","Data":"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"}
Oct 30 20:57:15.833910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.833343    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:15.833910 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.833367    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" event={"ID":"36d92a51-020a-48c1-85be-ef8b06d9ad36","Type":"ContainerStarted","Data":"1923cc2ce694752e401b6f697170a10e980b0dbecf82b7f839b38dd9b7de0efc"}
Oct 30 20:57:15.835831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.835800    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" event={"ID":"517afcf9-cb2c-44d1-b56e-55256dd24ee4","Type":"ContainerStarted","Data":"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"}
Oct 30 20:57:15.835831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.835855    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" event={"ID":"517afcf9-cb2c-44d1-b56e-55256dd24ee4","Type":"ContainerStarted","Data":"78bd28ffc31770d9a830dba29153aa4c42f5d8bdb032e47d2f74f5d758760ca4"}
Oct 30 20:57:15.836089 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.835884    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:15.854909 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.854861    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" podStartSLOduration=1.8548468310000001 podStartE2EDuration="1.854846831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:15.851044588 +0000 UTC m=+1097.654939392" watchObservedRunningTime="2026-10-30 20:57:15.854846831 +0000 UTC m=+1097.658741587"
Oct 30 20:57:15.873870 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:15.873814    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" podStartSLOduration=1.873798702 podStartE2EDuration="1.873798702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:15.86806795 +0000 UTC m=+1097.671962725" watchObservedRunningTime="2026-10-30 20:57:15.873798702 +0000 UTC m=+1097.677693458"
Oct 30 20:57:19.618374 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.618340    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:19.624415 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.624376    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.635479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.635436    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8d0462d9-serving-cert\""
Oct 30 20:57:19.644348 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.643248    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:19.697015 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.696975    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh2z8\" (UniqueName: \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.697253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.697109    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.697253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.697171    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.697253 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.697204    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.798423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.798389    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.798641 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.798446    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.798795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.798772    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh2z8\" (UniqueName: \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.798897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.798879    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.799507 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.799485    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.801263 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.801236    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.801415 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.801396    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.812834 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.812808    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh2z8\" (UniqueName: \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\") pod \"maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:19.951622 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:19.951480    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:20.287852 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:20.287791    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:20.881042 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:20.881005    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" event={"ID":"75fa66a8-d9d0-4414-ab12-3122e6264dce","Type":"ContainerStarted","Data":"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"}
Oct 30 20:57:20.881413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:20.881066    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" event={"ID":"75fa66a8-d9d0-4414-ab12-3122e6264dce","Type":"ContainerStarted","Data":"31e70c90717db12fc7855de9d1c54c3a1205031d7f230b61a8cb6e2843886f40"}
Oct 30 20:57:20.881413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:20.881094    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:20.921413 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:20.921345    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" podStartSLOduration=1.495719847 podStartE2EDuration="1.921327327s" totalImagesPullingTime="425.60748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:20.9181704 +0000 UTC m=+1102.722065182" watchObservedRunningTime="2026-10-30 20:57:20.921327327 +0000 UTC m=+1102.725222086"
Oct 30 20:57:24.131722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:24.131680    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:57:25.205122 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:25.204660    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:57:26.849183 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:26.849155    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:26.849587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:26.849222    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:26.913058 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:26.913025    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:28.860783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:28.860749    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:57:28.861975 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:28.861932    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerName="maas-api" containerID="cri-o://e8f5f2b64030701fabb46deb06db7149fbe27953d60ae5c5f04b83b17622e305" gracePeriod=30
Oct 30 20:57:29.033019 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.032982    5115 generic.go:356] "Generic (PLEG): container finished" podID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerID="e8f5f2b64030701fabb46deb06db7149fbe27953d60ae5c5f04b83b17622e305" exitCode=0
Oct 30 20:57:29.033286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.033266    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" event={"ID":"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4","Type":"ContainerDied","Data":"e8f5f2b64030701fabb46deb06db7149fbe27953d60ae5c5f04b83b17622e305"}
Oct 30 20:57:29.382471 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.382377    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:57:29.501050 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.501015    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\") pod \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") "
Oct 30 20:57:29.501237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.501143    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\" (UniqueName: \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\") pod \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") "
Oct 30 20:57:29.501317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.501280    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\") pod \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") "
Oct 30 20:57:29.501567 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.501502    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\") pod \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\" (UID: \"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4\") "
Oct 30 20:57:29.501925 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.501888    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca" pod "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" (UID: "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:29.502950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.502926    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:29.503788 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.503763    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs" pod "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" (UID: "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:29.503930 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.503910    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls" pod "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" (UID: "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:29.503980 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.503928    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69" pod "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" (UID: "c45800fe-d3ee-4d5a-b416-3b689e6cc8f4"). InnerVolumeSpecName "kube-api-access-smv69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:29.605639 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.605555    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smv69\" (UniqueName: \"kubernetes.io/projected/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-kube-api-access-smv69\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:29.605877 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.605848    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:29.605961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:29.605887    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.043675 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.043639    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" event={"ID":"c45800fe-d3ee-4d5a-b416-3b689e6cc8f4","Type":"ContainerDied","Data":"035843bc4749e2c7f2dc5dc340272a4bd1b8891504bed16d05d3eb0ded5abdbe"}
Oct 30 20:57:30.044072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.043690    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"
Oct 30 20:57:30.044072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.043742    5115 scope.go:122] "RemoveContainer" containerID="e8f5f2b64030701fabb46deb06db7149fbe27953d60ae5c5f04b83b17622e305"
Oct 30 20:57:30.070783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.070757    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:57:30.075156 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.075131    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz"]
Oct 30 20:57:30.373895 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:30.373799    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" path="/var/lib/kubelet/pods/c45800fe-d3ee-4d5a-b416-3b689e6cc8f4/volumes"
Oct 30 20:57:31.530755 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:31.530726    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:57:31.553123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:31.553094    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:57:32.192423 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:32.192370    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db534b-9db8bc-cpwnz" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.78:8443/health\": context deadline exceeded"
Oct 30 20:57:34.132165 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:34.132127    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:57:35.103509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.103314    5115 generic.go:356] "Generic (PLEG): container finished" podID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerID="37312ab56f9c3cdee012d48a0d30bc2f0983f0eccd869b5fbc42bd67f7b1ccee" exitCode=0
Oct 30 20:57:35.103509 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.103445    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" event={"ID":"2019cffa-9c92-4693-8a2e-377519a1aca0","Type":"ContainerDied","Data":"37312ab56f9c3cdee012d48a0d30bc2f0983f0eccd869b5fbc42bd67f7b1ccee"}
Oct 30 20:57:35.105479 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.105440    5115 generic.go:356] "Generic (PLEG): container finished" podID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerID="58e1ea50f1740701f741f779368c9d1fb25566f8e3778ab24665ac1668866d6d" exitCode=0
Oct 30 20:57:35.105693 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.105641    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" event={"ID":"716d5e83-5a2d-407c-bdca-2bce1950de32","Type":"ContainerDied","Data":"58e1ea50f1740701f741f779368c9d1fb25566f8e3778ab24665ac1668866d6d"}
Oct 30 20:57:35.266442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.266413    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:57:35.338165 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.338136    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:57:35.413359 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.413324    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\") pod \"716d5e83-5a2d-407c-bdca-2bce1950de32\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") "
Oct 30 20:57:35.413751 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.413714    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\" (UniqueName: \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\") pod \"2019cffa-9c92-4693-8a2e-377519a1aca0\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") "
Oct 30 20:57:35.413992 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.413777    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume" pod "716d5e83-5a2d-407c-bdca-2bce1950de32" (UID: "716d5e83-5a2d-407c-bdca-2bce1950de32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:35.414146 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.414124    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\" (UniqueName: \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\") pod \"716d5e83-5a2d-407c-bdca-2bce1950de32\" (UID: \"716d5e83-5a2d-407c-bdca-2bce1950de32\") "
Oct 30 20:57:35.414513 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.414493    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\") pod \"2019cffa-9c92-4693-8a2e-377519a1aca0\" (UID: \"2019cffa-9c92-4693-8a2e-377519a1aca0\") "
Oct 30 20:57:35.415151 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.415022    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume" pod "2019cffa-9c92-4693-8a2e-377519a1aca0" (UID: "2019cffa-9c92-4693-8a2e-377519a1aca0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:35.416871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.416844    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn" pod "2019cffa-9c92-4693-8a2e-377519a1aca0" (UID: "2019cffa-9c92-4693-8a2e-377519a1aca0"). InnerVolumeSpecName "kube-api-access-rn6vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:35.417287 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.417151    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2019cffa-9c92-4693-8a2e-377519a1aca0-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:35.417409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.417317    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/716d5e83-5a2d-407c-bdca-2bce1950de32-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:35.417409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.417240    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j" pod "716d5e83-5a2d-407c-bdca-2bce1950de32" (UID: "716d5e83-5a2d-407c-bdca-2bce1950de32"). InnerVolumeSpecName "kube-api-access-7889j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:35.518393 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.518362    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7889j\" (UniqueName: \"kubernetes.io/projected/716d5e83-5a2d-407c-bdca-2bce1950de32-kube-api-access-7889j\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:35.518393 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:35.518393    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn6vn\" (UniqueName: \"kubernetes.io/projected/2019cffa-9c92-4693-8a2e-377519a1aca0-kube-api-access-rn6vn\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:36.115872 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.115842    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"
Oct 30 20:57:36.116091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.115866    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c" event={"ID":"2019cffa-9c92-4693-8a2e-377519a1aca0","Type":"ContainerDied","Data":"fe9e6704c723a3f95d3ccd378e99443efaed5ec059249c24c19c921b102cd7a8"}
Oct 30 20:57:36.116091 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.115933    5115 scope.go:122] "RemoveContainer" containerID="37312ab56f9c3cdee012d48a0d30bc2f0983f0eccd869b5fbc42bd67f7b1ccee"
Oct 30 20:57:36.117606 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.117579    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" event={"ID":"716d5e83-5a2d-407c-bdca-2bce1950de32","Type":"ContainerDied","Data":"0483e05598e645a18a9094b783f13684655b223fba298952fcf4feb046713ad1"}
Oct 30 20:57:36.117714 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.117595    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:57:36.131578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.131276    5115 scope.go:122] "RemoveContainer" containerID="58e1ea50f1740701f741f779368c9d1fb25566f8e3778ab24665ac1668866d6d"
Oct 30 20:57:36.144837 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.144812    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:57:36.149152 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.149059    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.72:50052\" within 1s: context deadline exceeded"
Oct 30 20:57:36.149152 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:57:36.149129    5115 logging.go:55] [core] [Channel #1738 SubChannel #1739]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.72:50052", ServerName: "10.132.0.72:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.72:50052: operation was canceled"
Oct 30 20:57:36.149336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.149158    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"
Oct 30 20:57:36.152320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.152294    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-db534b-68bd974bc9-64l2c"]
Oct 30 20:57:36.163765 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.163731    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:57:36.169575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.169545    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-db534b-7979bf57d-2428c"]
Oct 30 20:57:36.282456 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:36.282421    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:57:36.370927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.370895    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" path="/var/lib/kubelet/pods/2019cffa-9c92-4693-8a2e-377519a1aca0/volumes"
Oct 30 20:57:36.371360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.371346    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" path="/var/lib/kubelet/pods/716d5e83-5a2d-407c-bdca-2bce1950de32/volumes"
Oct 30 20:57:36.531775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.531728    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" podUID="f3c37318-59d8-41f0-ad68-14f3dea42f87" containerName="payload-processing" containerID="cri-o://eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51" gracePeriod=25
Oct 30 20:57:36.554365 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.554318    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" podUID="f207df28-a990-463e-861e-dc92b44c02a5" containerName="payload-pre-processing" containerID="cri-o://983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7" gracePeriod=25
Oct 30 20:57:36.906614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.906580    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:36.908013 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.907981    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" podUID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" containerName="maas-api" containerID="cri-o://74c4cd925622599e0dfa75fd91db91899c6359cae09a11a2a4ee6a087811da25" gracePeriod=30
Oct 30 20:57:36.910637 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:36.906987    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:57:37.055240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.055200    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\" (UniqueName: \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\") pod \"f3c37318-59d8-41f0-ad68-14f3dea42f87\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") "
Oct 30 20:57:37.057798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.057774    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\") pod \"f3c37318-59d8-41f0-ad68-14f3dea42f87\" (UID: \"f3c37318-59d8-41f0-ad68-14f3dea42f87\") "
Oct 30 20:57:37.059497 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.058361    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume" pod "f3c37318-59d8-41f0-ad68-14f3dea42f87" (UID: "f3c37318-59d8-41f0-ad68-14f3dea42f87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:37.059938 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.058553    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48" pod "f3c37318-59d8-41f0-ad68-14f3dea42f87" (UID: "f3c37318-59d8-41f0-ad68-14f3dea42f87"). InnerVolumeSpecName "kube-api-access-xml48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:37.061258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.060131    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:57:37.202874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.191615    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\") pod \"f207df28-a990-463e-861e-dc92b44c02a5\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") "
Oct 30 20:57:37.215672 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.204668    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume" pod "f207df28-a990-463e-861e-dc92b44c02a5" (UID: "f207df28-a990-463e-861e-dc92b44c02a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:37.223309 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.221963    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\" (UniqueName: \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\") pod \"f207df28-a990-463e-861e-dc92b44c02a5\" (UID: \"f207df28-a990-463e-861e-dc92b44c02a5\") "
Oct 30 20:57:37.223309 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.222874    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xml48\" (UniqueName: \"kubernetes.io/projected/f3c37318-59d8-41f0-ad68-14f3dea42f87-kube-api-access-xml48\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.223309 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.222899    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3c37318-59d8-41f0-ad68-14f3dea42f87-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.223309 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.222913    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f207df28-a990-463e-861e-dc92b44c02a5-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.226325 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.226277    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw" pod "f207df28-a990-463e-861e-dc92b44c02a5" (UID: "f207df28-a990-463e-861e-dc92b44c02a5"). InnerVolumeSpecName "kube-api-access-z7btw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:37.256927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.256881    5115 generic.go:356] "Generic (PLEG): container finished" podID="f207df28-a990-463e-861e-dc92b44c02a5" containerID="983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7" exitCode=0
Oct 30 20:57:37.257104 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.257076    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" event={"ID":"f207df28-a990-463e-861e-dc92b44c02a5","Type":"ContainerDied","Data":"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"}
Oct 30 20:57:37.257184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.257130    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d" event={"ID":"f207df28-a990-463e-861e-dc92b44c02a5","Type":"ContainerDied","Data":"5abc31d55338a9890cbe3de8444be2c1ab0988f6a0d61a2c2ef559c140ec0e13"}
Oct 30 20:57:37.257184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.257161    5115 scope.go:122] "RemoveContainer" containerID="983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"
Oct 30 20:57:37.261027 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.257347    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"
Oct 30 20:57:37.271968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.271656    5115 generic.go:356] "Generic (PLEG): container finished" podID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" containerID="74c4cd925622599e0dfa75fd91db91899c6359cae09a11a2a4ee6a087811da25" exitCode=0
Oct 30 20:57:37.271968 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.271835    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" event={"ID":"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0","Type":"ContainerDied","Data":"74c4cd925622599e0dfa75fd91db91899c6359cae09a11a2a4ee6a087811da25"}
Oct 30 20:57:37.277776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.275104    5115 generic.go:356] "Generic (PLEG): container finished" podID="f3c37318-59d8-41f0-ad68-14f3dea42f87" containerID="eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51" exitCode=0
Oct 30 20:57:37.277776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.275210    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" event={"ID":"f3c37318-59d8-41f0-ad68-14f3dea42f87","Type":"ContainerDied","Data":"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"}
Oct 30 20:57:37.277776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.275256    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75" event={"ID":"f3c37318-59d8-41f0-ad68-14f3dea42f87","Type":"ContainerDied","Data":"01787658f248acdeebf8f46b769271f0a08bf34e8651e2c5f6856625b9e0c48e"}
Oct 30 20:57:37.277776 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.275335    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"
Oct 30 20:57:37.303285 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.303257    5115 scope.go:122] "RemoveContainer" containerID="983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"
Oct 30 20:57:37.308184 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:37.307082    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7\": container with ID starting with 983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7 not found: ID does not exist" containerID="983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"
Oct 30 20:57:37.308184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.307127    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7"} err="failed to get container status \"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7\": rpc error: code = NotFound desc = could not find container \"983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7\": container with ID starting with 983fc2e21675b05e24334f03b2f177b91356f2a0ed6ce9b22b59777545fbf5f7 not found: ID does not exist"
Oct 30 20:57:37.308184 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.307151    5115 scope.go:122] "RemoveContainer" containerID="eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"
Oct 30 20:57:37.415483 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.415414    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7btw\" (UniqueName: \"kubernetes.io/projected/f207df28-a990-463e-861e-dc92b44c02a5-kube-api-access-z7btw\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.416858 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.415849    5115 scope.go:122] "RemoveContainer" containerID="eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"
Oct 30 20:57:37.417153 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:37.417114    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51\": container with ID starting with eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51 not found: ID does not exist" containerID="eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"
Oct 30 20:57:37.417256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.417163    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51"} err="failed to get container status \"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51\": rpc error: code = NotFound desc = could not find container \"eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51\": container with ID starting with eb172f890132374b472125614c6e5f0ad7081608f32f75df87fc4d1521cdfd51 not found: ID does not exist"
Oct 30 20:57:37.440343 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.440300    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:57:37.485736 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.485277    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a4317e67-5cf656c4c5-v948d"]
Oct 30 20:57:37.513281 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.513241    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:57:37.530498 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.530467    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a4317e67-7cdb5fcfb8-chn75"]
Oct 30 20:57:37.556328 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.556283    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:37.634155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.626091    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\") pod \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") "
Oct 30 20:57:37.634155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.626158    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\") pod \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") "
Oct 30 20:57:37.634155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.626297    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\" (UniqueName: \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\") pod \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") "
Oct 30 20:57:37.634155 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.626361    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\") pod \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\" (UID: \"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0\") "
Oct 30 20:57:37.634900 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.634784    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca" pod "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" (UID: "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:37.642855 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.642803    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk" pod "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" (UID: "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0"). InnerVolumeSpecName "kube-api-access-v77kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:37.665674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.663893    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs" pod "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" (UID: "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:37.671003 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.670947    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls" pod "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" (UID: "c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:37.728510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.728474    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.728822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.728801    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.728939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.728925    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v77kk\" (UniqueName: \"kubernetes.io/projected/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-kube-api-access-v77kk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.729040 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.729026    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:37.913353 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.913317    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:57:37.913587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.913561    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" containerID="cri-o://212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e" gracePeriod=30
Oct 30 20:57:37.921793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.921714    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:57:37.921995 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:37.921968    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" containerID="cri-o://d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27" gracePeriod=30
Oct 30 20:57:38.026182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.024192    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:57:38.026182 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.024444    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" containerID="cri-o://d7dfd21cc193a842b3c9a564879ad683170096de4ff60085983e95d2e999bad6" gracePeriod=30
Oct 30 20:57:38.290882 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.290851    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"
Oct 30 20:57:38.291098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.290889    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2" event={"ID":"c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0","Type":"ContainerDied","Data":"95b954d62a6d7b9a1dc9f2d555fc8f6622657d43f5f9fd15e336b39735567279"}
Oct 30 20:57:38.291098 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.290964    5115 scope.go:122] "RemoveContainer" containerID="74c4cd925622599e0dfa75fd91db91899c6359cae09a11a2a4ee6a087811da25"
Oct 30 20:57:38.327722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.327685    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:38.336772 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.336734    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a4317e67-6647f674fd-wdrt2"]
Oct 30 20:57:38.375387 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.375355    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" path="/var/lib/kubelet/pods/c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0/volumes"
Oct 30 20:57:38.376165 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.376134    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f207df28-a990-463e-861e-dc92b44c02a5" path="/var/lib/kubelet/pods/f207df28-a990-463e-861e-dc92b44c02a5/volumes"
Oct 30 20:57:38.376891 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.376865    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3c37318-59d8-41f0-ad68-14f3dea42f87" path="/var/lib/kubelet/pods/f3c37318-59d8-41f0-ad68-14f3dea42f87/volumes"
Oct 30 20:57:38.802202 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.802162    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:38.822839 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:38.822317    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:40.580293 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.580259    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:40.580860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.580313    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:40.808629 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.808591    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:40.808782 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.808656    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:40.994574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.994451    5115 patch_prober.go:29] interesting pod/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:40.994574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:40.994507    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:41.332620 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.332590    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:41.332831 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.332806    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" podUID="75fa66a8-d9d0-4414-ab12-3122e6264dce" containerName="maas-api" containerID="cri-o://d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4" gracePeriod=30
Oct 30 20:57:41.741927 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.741898    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:41.845022 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.844984    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\" (UniqueName: \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\") pod \"75fa66a8-d9d0-4414-ab12-3122e6264dce\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") "
Oct 30 20:57:41.845211 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.845154    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\") pod \"75fa66a8-d9d0-4414-ab12-3122e6264dce\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") "
Oct 30 20:57:41.845292 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.845276    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\") pod \"75fa66a8-d9d0-4414-ab12-3122e6264dce\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") "
Oct 30 20:57:41.845430 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.845413    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\") pod \"75fa66a8-d9d0-4414-ab12-3122e6264dce\" (UID: \"75fa66a8-d9d0-4414-ab12-3122e6264dce\") "
Oct 30 20:57:41.846647 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.846615    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca" pod "75fa66a8-d9d0-4414-ab12-3122e6264dce" (UID: "75fa66a8-d9d0-4414-ab12-3122e6264dce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:41.850147 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.850116    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8" pod "75fa66a8-d9d0-4414-ab12-3122e6264dce" (UID: "75fa66a8-d9d0-4414-ab12-3122e6264dce"). InnerVolumeSpecName "kube-api-access-rh2z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:41.853598 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.853573    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls" pod "75fa66a8-d9d0-4414-ab12-3122e6264dce" (UID: "75fa66a8-d9d0-4414-ab12-3122e6264dce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:41.853674 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.853588    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs" pod "75fa66a8-d9d0-4414-ab12-3122e6264dce" (UID: "75fa66a8-d9d0-4414-ab12-3122e6264dce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:41.957864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.948234    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:41.957864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.948279    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75fa66a8-d9d0-4414-ab12-3122e6264dce-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:41.957864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.948296    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75fa66a8-d9d0-4414-ab12-3122e6264dce-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:41.957864 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:41.948310    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh2z8\" (UniqueName: \"kubernetes.io/projected/75fa66a8-d9d0-4414-ab12-3122e6264dce-kube-api-access-rh2z8\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:42.342810 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.342776    5115 generic.go:356] "Generic (PLEG): container finished" podID="75fa66a8-d9d0-4414-ab12-3122e6264dce" containerID="d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4" exitCode=0
Oct 30 20:57:42.343004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.342820    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"
Oct 30 20:57:42.343004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.342854    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" event={"ID":"75fa66a8-d9d0-4414-ab12-3122e6264dce","Type":"ContainerDied","Data":"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"}
Oct 30 20:57:42.343004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.342919    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm" event={"ID":"75fa66a8-d9d0-4414-ab12-3122e6264dce","Type":"ContainerDied","Data":"31e70c90717db12fc7855de9d1c54c3a1205031d7f230b61a8cb6e2843886f40"}
Oct 30 20:57:42.343004 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.342953    5115 scope.go:122] "RemoveContainer" containerID="d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"
Oct 30 20:57:42.354798 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.354777    5115 scope.go:122] "RemoveContainer" containerID="d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"
Oct 30 20:57:42.355099 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:42.355074    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4\": container with ID starting with d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4 not found: ID does not exist" containerID="d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"
Oct 30 20:57:42.355171 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.355109    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4"} err="failed to get container status \"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4\": rpc error: code = NotFound desc = could not find container \"d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4\": container with ID starting with d8113a52d12e81f8fb491cd665dca214c0210bf16b89b28f3985bc1247fb0ac4 not found: ID does not exist"
Oct 30 20:57:42.372711 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.372684    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:42.372806 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:42.372726    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8d0462d9-686999d5fc-lvhnm"]
Oct 30 20:57:43.239002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.238959    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:57:43.257901 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.257873    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:57:43.355981 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.355952    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:57:43.356190 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.356150    5115 generic.go:356] "Generic (PLEG): container finished" podID="1402c404-8b23-4998-afd9-51147b1116ba" containerID="d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27" exitCode=0
Oct 30 20:57:43.356320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.356194    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" event={"ID":"1402c404-8b23-4998-afd9-51147b1116ba","Type":"ContainerDied","Data":"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"}
Oct 30 20:57:43.356320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.356219    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"
Oct 30 20:57:43.356320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.356252    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75" event={"ID":"1402c404-8b23-4998-afd9-51147b1116ba","Type":"ContainerDied","Data":"118fea5953c1e15a05d2fd63a1f9376a4bb7523945df7d6b56acb1071b527280"}
Oct 30 20:57:43.356320 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.356284    5115 scope.go:122] "RemoveContainer" containerID="d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"
Oct 30 20:57:43.358018 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.357995    5115 generic.go:356] "Generic (PLEG): container finished" podID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerID="d7dfd21cc193a842b3c9a564879ad683170096de4ff60085983e95d2e999bad6" exitCode=0
Oct 30 20:57:43.358124 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.358106    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97" event={"ID":"4bf92ecc-3fef-4d23-9950-f7bb882f633a","Type":"ContainerDied","Data":"d7dfd21cc193a842b3c9a564879ad683170096de4ff60085983e95d2e999bad6"}
Oct 30 20:57:43.358185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.358112    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"
Oct 30 20:57:43.359876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.359852    5115 generic.go:356] "Generic (PLEG): container finished" podID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerID="212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e" exitCode=0
Oct 30 20:57:43.359994 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.359905    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"
Oct 30 20:57:43.359994 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.359935    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" event={"ID":"1668fb16-2f70-40d5-be0d-dc505a50c774","Type":"ContainerDied","Data":"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"}
Oct 30 20:57:43.359994 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.359973    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5" event={"ID":"1668fb16-2f70-40d5-be0d-dc505a50c774","Type":"ContainerDied","Data":"fcf91c04de34769884346ad34efd608baa2a99e10c6b39f0254ce4eef8dd3653"}
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372073    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372286    5115 scope.go:122] "RemoveContainer" containerID="d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372505    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372775    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372876    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.372911    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373031    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373081    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373127 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373129    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373178    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373266    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373298    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373342    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373387    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373427    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373489    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:43.373489    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27\": container with ID starting with d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27 not found: ID does not exist" containerID="d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373538    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373540    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27"} err="failed to get container status \"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27\": rpc error: code = NotFound desc = could not find container \"d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27\": container with ID starting with d6381a072609e1c05745fe0e6d0d8afe878aa397a1dd4fd4b2dc85b877272e27 not found: ID does not exist"
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373567    5115 scope.go:122] "RemoveContainer" containerID="d7dfd21cc193a842b3c9a564879ad683170096de4ff60085983e95d2e999bad6"
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373594    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\") pod \"1668fb16-2f70-40d5-be0d-dc505a50c774\" (UID: \"1668fb16-2f70-40d5-be0d-dc505a50c774\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373645    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.373704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373695    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\") pod \"1402c404-8b23-4998-afd9-51147b1116ba\" (UID: \"1402c404-8b23-4998-afd9-51147b1116ba\") "
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.373866    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.374059    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.374606    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.374627    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.374642    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.375030    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.376969 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.375314    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:43.377733 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.377702    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.377929 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.377897    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.378623 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.378595    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "kube-api-access-wlvbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.378795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.378769    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.378943 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.378923    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.379017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.378984    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.379952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.379925    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:43.381206 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.381184    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.381281 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.381213    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.382579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.381402    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "kube-api-access-v2hnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.382579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.381444    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo" pod "1402c404-8b23-4998-afd9-51147b1116ba" (UID: "1402c404-8b23-4998-afd9-51147b1116ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:43.388670 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.388645    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.394806 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.394774    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo" pod "1668fb16-2f70-40d5-be0d-dc505a50c774" (UID: "1668fb16-2f70-40d5-be0d-dc505a50c774"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:43.406372 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.406332    5115 scope.go:122] "RemoveContainer" containerID="212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"
Oct 30 20:57:43.420859 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.420830    5115 scope.go:122] "RemoveContainer" containerID="212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"
Oct 30 20:57:43.421195 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:43.421174    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e\": container with ID starting with 212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e not found: ID does not exist" containerID="212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"
Oct 30 20:57:43.421260 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.421205    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e"} err="failed to get container status \"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e\": rpc error: code = NotFound desc = could not find container \"212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e\": container with ID starting with 212dbebe1b1750b079b08b4a0d3c4cf8c3eee11ec5d4e9c565896033c28e891e not found: ID does not exist"
Oct 30 20:57:43.476139 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476065    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476147    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476174    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476227    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476322    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476351    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476390    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.476448 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476421    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476452    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.476687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476608    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476800 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476715    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.476852 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476793    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\") pod \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\" (UID: \"4bf92ecc-3fef-4d23-9950-f7bb882f633a\") "
Oct 30 20:57:43.476852 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476801    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:43.476997 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.476969    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.477573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477546    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477577    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477593    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlvbx\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-kube-api-access-wlvbx\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477610    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1402c404-8b23-4998-afd9-51147b1116ba-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477624    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477639    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477653    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.477668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477667    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477683    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477698    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477713    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477726    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1402c404-8b23-4998-afd9-51147b1116ba-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477740    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1668fb16-2f70-40d5-be0d-dc505a50c774-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477754    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1668fb16-2f70-40d5-be0d-dc505a50c774-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477768    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477783    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1668fb16-2f70-40d5-be0d-dc505a50c774-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477796    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1402c404-8b23-4998-afd9-51147b1116ba-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477811    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477825    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-kube-api-access-v2hnd\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.478052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.477840    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1402c404-8b23-4998-afd9-51147b1116ba-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.479339 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.479314    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:43.479475 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.479387    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:43.479643 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.479573    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.480176 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.480156    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw" pod "4bf92ecc-3fef-4d23-9950-f7bb882f633a" (UID: "4bf92ecc-3fef-4d23-9950-f7bb882f633a"). InnerVolumeSpecName "kube-api-access-fhdgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:43.580106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.580066    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdgw\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-kube-api-access-fhdgw\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.580106 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.580106    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.580322 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.580122    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.580322 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.580134    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bf92ecc-3fef-4d23-9950-f7bb882f633a-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:43.690653 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.690621    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:57:43.693977 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.693953    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-l8n75"]
Oct 30 20:57:43.703679 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.703655    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:57:43.707632 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.707610    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-6pwj5"]
Oct 30 20:57:43.721425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.721396    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:57:43.727724 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.727635    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db534b-openshift-default-85df4d79d9-gqn97"]
Oct 30 20:57:43.820145 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.819591    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" podUID="36d92a51-020a-48c1-85be-ef8b06d9ad36" containerName="payload-processing" containerID="cri-o://d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995" gracePeriod=25
Oct 30 20:57:43.824383 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:43.824306    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" podUID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" containerName="payload-pre-processing" containerID="cri-o://53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a" gracePeriod=25
Oct 30 20:57:44.181813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.181786    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:44.214744 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.214717    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:44.295161 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295073    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\" (UniqueName: \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\") pod \"36d92a51-020a-48c1-85be-ef8b06d9ad36\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") "
Oct 30 20:57:44.295705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295339    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\") pod \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") "
Oct 30 20:57:44.295705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295376    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\") pod \"36d92a51-020a-48c1-85be-ef8b06d9ad36\" (UID: \"36d92a51-020a-48c1-85be-ef8b06d9ad36\") "
Oct 30 20:57:44.295705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295438    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\" (UniqueName: \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\") pod \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\" (UID: \"517afcf9-cb2c-44d1-b56e-55256dd24ee4\") "
Oct 30 20:57:44.295988 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295783    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume" pod "517afcf9-cb2c-44d1-b56e-55256dd24ee4" (UID: "517afcf9-cb2c-44d1-b56e-55256dd24ee4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:44.295988 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.295808    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume" pod "36d92a51-020a-48c1-85be-ef8b06d9ad36" (UID: "36d92a51-020a-48c1-85be-ef8b06d9ad36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:44.296160 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.296142    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517afcf9-cb2c-44d1-b56e-55256dd24ee4-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:44.296243 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.296166    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36d92a51-020a-48c1-85be-ef8b06d9ad36-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:44.298041 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.298012    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz" pod "517afcf9-cb2c-44d1-b56e-55256dd24ee4" (UID: "517afcf9-cb2c-44d1-b56e-55256dd24ee4"). InnerVolumeSpecName "kube-api-access-m4qnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:44.298162 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.298045    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf" pod "36d92a51-020a-48c1-85be-ef8b06d9ad36" (UID: "36d92a51-020a-48c1-85be-ef8b06d9ad36"). InnerVolumeSpecName "kube-api-access-lt7cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:44.374807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.374761    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1402c404-8b23-4998-afd9-51147b1116ba" path="/var/lib/kubelet/pods/1402c404-8b23-4998-afd9-51147b1116ba/volumes"
Oct 30 20:57:44.375002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.374859    5115 generic.go:356] "Generic (PLEG): container finished" podID="36d92a51-020a-48c1-85be-ef8b06d9ad36" containerID="d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995" exitCode=0
Oct 30 20:57:44.375002 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.374959    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"
Oct 30 20:57:44.375504 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.375482    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" path="/var/lib/kubelet/pods/1668fb16-2f70-40d5-be0d-dc505a50c774/volumes"
Oct 30 20:57:44.376057 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.376040    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" path="/var/lib/kubelet/pods/4bf92ecc-3fef-4d23-9950-f7bb882f633a/volumes"
Oct 30 20:57:44.376976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.376955    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75fa66a8-d9d0-4414-ab12-3122e6264dce" path="/var/lib/kubelet/pods/75fa66a8-d9d0-4414-ab12-3122e6264dce/volumes"
Oct 30 20:57:44.377718 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.377695    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" event={"ID":"36d92a51-020a-48c1-85be-ef8b06d9ad36","Type":"ContainerDied","Data":"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"}
Oct 30 20:57:44.377818 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.377728    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj" event={"ID":"36d92a51-020a-48c1-85be-ef8b06d9ad36","Type":"ContainerDied","Data":"1923cc2ce694752e401b6f697170a10e980b0dbecf82b7f839b38dd9b7de0efc"}
Oct 30 20:57:44.377818 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.377760    5115 scope.go:122] "RemoveContainer" containerID="d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"
Oct 30 20:57:44.379344 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.379321    5115 generic.go:356] "Generic (PLEG): container finished" podID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" containerID="53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a" exitCode=0
Oct 30 20:57:44.379429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.379363    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"
Oct 30 20:57:44.379429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.379415    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" event={"ID":"517afcf9-cb2c-44d1-b56e-55256dd24ee4","Type":"ContainerDied","Data":"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"}
Oct 30 20:57:44.379561 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.379468    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx" event={"ID":"517afcf9-cb2c-44d1-b56e-55256dd24ee4","Type":"ContainerDied","Data":"78bd28ffc31770d9a830dba29153aa4c42f5d8bdb032e47d2f74f5d758760ca4"}
Oct 30 20:57:44.397336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.397312    5115 scope.go:122] "RemoveContainer" containerID="d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"
Oct 30 20:57:44.398007 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:44.397977    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995\": container with ID starting with d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995 not found: ID does not exist" containerID="d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"
Oct 30 20:57:44.398126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.398016    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995"} err="failed to get container status \"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995\": rpc error: code = NotFound desc = could not find container \"d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995\": container with ID starting with d5b6860aa2106e8aea13a3f8221d54abadef8436ca1817b43986689706666995 not found: ID does not exist"
Oct 30 20:57:44.398126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.398038    5115 scope.go:122] "RemoveContainer" containerID="53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"
Oct 30 20:57:44.398379 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.398355    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4qnz\" (UniqueName: \"kubernetes.io/projected/517afcf9-cb2c-44d1-b56e-55256dd24ee4-kube-api-access-m4qnz\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:44.398435 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.398387    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt7cf\" (UniqueName: \"kubernetes.io/projected/36d92a51-020a-48c1-85be-ef8b06d9ad36-kube-api-access-lt7cf\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:57:44.410768 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.410747    5115 scope.go:122] "RemoveContainer" containerID="53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"
Oct 30 20:57:44.411046 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:57:44.411012    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a\": container with ID starting with 53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a not found: ID does not exist" containerID="53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"
Oct 30 20:57:44.411095 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.411057    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a"} err="failed to get container status \"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a\": rpc error: code = NotFound desc = could not find container \"53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a\": container with ID starting with 53b0c9507e52d35d012967f42d4226d275da7395ecbba8392533220d4516988a not found: ID does not exist"
Oct 30 20:57:44.413961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.413940    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:44.417976 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.417957    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8d0462d9-559dd56bfd-fw5wj"]
Oct 30 20:57:44.430846 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.430823    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:44.436095 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:44.436072    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8d0462d9-8549dff9-kkddx"]
Oct 30 20:57:46.371644 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:46.371610    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36d92a51-020a-48c1-85be-ef8b06d9ad36" path="/var/lib/kubelet/pods/36d92a51-020a-48c1-85be-ef8b06d9ad36/volumes"
Oct 30 20:57:46.372250 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:46.372228    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" path="/var/lib/kubelet/pods/517afcf9-cb2c-44d1-b56e-55256dd24ee4/volumes"
Oct 30 20:57:52.665219 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:52.665173    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:57:52.698555 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:52.687662    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:57:56.269650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:56.269613    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:57:56.275437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:56.275406    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:57:57.665829 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:57.665786    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing" containerID="cri-o://f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30" gracePeriod=25
Oct 30 20:57:57.688722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:57:57.688676    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing" containerID="cri-o://1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348" gracePeriod=25
Oct 30 20:58:01.271093 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:01.271029    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing" containerID="cri-o://de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0" gracePeriod=25
Oct 30 20:58:01.276585 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:01.276545    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing" containerID="cri-o://9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2" gracePeriod=25
Oct 30 20:58:03.108960 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:03.108916    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:03.108960 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:03.108948    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:06.264168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:06.264125    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:06.264168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:06.264145    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:06.280631 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:06.280599    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:58:12.055823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.055598    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:58:12.061172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.061136    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" podUID="a08d3843-5750-4675-aa3d-0a4a673fe053" containerName="maas-api" containerID="cri-o://098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3" gracePeriod=30
Oct 30 20:58:12.557593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.556759    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:58:12.689129 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.689095    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\") pod \"a08d3843-5750-4675-aa3d-0a4a673fe053\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") "
Oct 30 20:58:12.689363 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.689345    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\" (UniqueName: \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\") pod \"a08d3843-5750-4675-aa3d-0a4a673fe053\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") "
Oct 30 20:58:12.689437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.689427    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\") pod \"a08d3843-5750-4675-aa3d-0a4a673fe053\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") "
Oct 30 20:58:12.689487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.689474    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\") pod \"a08d3843-5750-4675-aa3d-0a4a673fe053\" (UID: \"a08d3843-5750-4675-aa3d-0a4a673fe053\") "
Oct 30 20:58:12.690784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.690750    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca" pod "a08d3843-5750-4675-aa3d-0a4a673fe053" (UID: "a08d3843-5750-4675-aa3d-0a4a673fe053"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:12.694078 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.694046    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls" pod "a08d3843-5750-4675-aa3d-0a4a673fe053" (UID: "a08d3843-5750-4675-aa3d-0a4a673fe053"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:12.694958 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.694929    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp" pod "a08d3843-5750-4675-aa3d-0a4a673fe053" (UID: "a08d3843-5750-4675-aa3d-0a4a673fe053"). InnerVolumeSpecName "kube-api-access-cg9pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:12.697420 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.697391    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs" pod "a08d3843-5750-4675-aa3d-0a4a673fe053" (UID: "a08d3843-5750-4675-aa3d-0a4a673fe053"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:12.720346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.720317    5115 generic.go:356] "Generic (PLEG): container finished" podID="a08d3843-5750-4675-aa3d-0a4a673fe053" containerID="098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3" exitCode=0
Oct 30 20:58:12.720485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.720373    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"
Oct 30 20:58:12.720485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.720400    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" event={"ID":"a08d3843-5750-4675-aa3d-0a4a673fe053","Type":"ContainerDied","Data":"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"}
Oct 30 20:58:12.720485 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.720468    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw" event={"ID":"a08d3843-5750-4675-aa3d-0a4a673fe053","Type":"ContainerDied","Data":"14621f3ad72c0511c636fb39b8971f865f65928d2e4e754508b6725001032f32"}
Oct 30 20:58:12.720729 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.720587    5115 scope.go:122] "RemoveContainer" containerID="098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"
Oct 30 20:58:12.736101 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.736082    5115 scope.go:122] "RemoveContainer" containerID="098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"
Oct 30 20:58:12.737068 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:12.737039    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3\": container with ID starting with 098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3 not found: ID does not exist" containerID="098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"
Oct 30 20:58:12.737168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.737079    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3"} err="failed to get container status \"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3\": rpc error: code = NotFound desc = could not find container \"098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3\": container with ID starting with 098ea01d636b49acd551df11b9a2259641fb957c0b054c5467e1c7996a2b69b3 not found: ID does not exist"
Oct 30 20:58:12.752025 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.751959    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:58:12.756162 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.756133    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ad7ff0-669b56d9f9-2mpcw"]
Oct 30 20:58:12.791587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.791550    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg9pp\" (UniqueName: \"kubernetes.io/projected/a08d3843-5750-4675-aa3d-0a4a673fe053-kube-api-access-cg9pp\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:12.791587 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.791586    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d3843-5750-4675-aa3d-0a4a673fe053-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:12.791796 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.791598    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:12.791796 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:12.791607    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08d3843-5750-4675-aa3d-0a4a673fe053-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.109159 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:13.109124    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:13.109688 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:13.109122    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:14.370579 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:14.370544    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a08d3843-5750-4675-aa3d-0a4a673fe053" path="/var/lib/kubelet/pods/a08d3843-5750-4675-aa3d-0a4a673fe053/volumes"
Oct 30 20:58:16.262432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:16.262390    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:16.262432 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:16.262409    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:17.989189 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:17.989163    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:58:18.032453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.032416    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:58:18.093299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093265    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\") pod \"7caade46-7205-4e71-976e-444d0d394630\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") "
Oct 30 20:58:18.093499 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093339    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\") pod \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") "
Oct 30 20:58:18.093499 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093448    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\" (UniqueName: \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\") pod \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\" (UID: \"3f3a82a7-d1c7-40e1-8978-fd81253fc35e\") "
Oct 30 20:58:18.093657 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093507    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\" (UniqueName: \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\") pod \"7caade46-7205-4e71-976e-444d0d394630\" (UID: \"7caade46-7205-4e71-976e-444d0d394630\") "
Oct 30 20:58:18.093793 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093762    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume" pod "7caade46-7205-4e71-976e-444d0d394630" (UID: "7caade46-7205-4e71-976e-444d0d394630"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:18.093872 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.093805    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume" pod "3f3a82a7-d1c7-40e1-8978-fd81253fc35e" (UID: "3f3a82a7-d1c7-40e1-8978-fd81253fc35e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:18.094276 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.094250    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7caade46-7205-4e71-976e-444d0d394630-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:18.094364 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.094278    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:18.096072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.096035    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm" pod "7caade46-7205-4e71-976e-444d0d394630" (UID: "7caade46-7205-4e71-976e-444d0d394630"). InnerVolumeSpecName "kube-api-access-hqvlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:18.096165 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.096128    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5" pod "3f3a82a7-d1c7-40e1-8978-fd81253fc35e" (UID: "3f3a82a7-d1c7-40e1-8978-fd81253fc35e"). InnerVolumeSpecName "kube-api-access-xtrc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:18.196126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.196040    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtrc5\" (UniqueName: \"kubernetes.io/projected/3f3a82a7-d1c7-40e1-8978-fd81253fc35e-kube-api-access-xtrc5\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:18.196126 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.196072    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqvlm\" (UniqueName: \"kubernetes.io/projected/7caade46-7205-4e71-976e-444d0d394630-kube-api-access-hqvlm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:18.772085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.772049    5115 generic.go:356] "Generic (PLEG): container finished" podID="7caade46-7205-4e71-976e-444d0d394630" containerID="1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348" exitCode=0
Oct 30 20:58:18.772256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.772098    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"
Oct 30 20:58:18.772256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.772140    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" event={"ID":"7caade46-7205-4e71-976e-444d0d394630","Type":"ContainerDied","Data":"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"}
Oct 30 20:58:18.772256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.772201    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4" event={"ID":"7caade46-7205-4e71-976e-444d0d394630","Type":"ContainerDied","Data":"210c8740725dc6ad4b8ba356c38e7a3d2a1e08ce321707e61b058658ae2bf40a"}
Oct 30 20:58:18.772256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.772234    5115 scope.go:122] "RemoveContainer" containerID="1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"
Oct 30 20:58:18.773743 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.773718    5115 generic.go:356] "Generic (PLEG): container finished" podID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerID="f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30" exitCode=0
Oct 30 20:58:18.774215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.773774    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"
Oct 30 20:58:18.774215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.773798    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" event={"ID":"3f3a82a7-d1c7-40e1-8978-fd81253fc35e","Type":"ContainerDied","Data":"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"}
Oct 30 20:58:18.774215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.773840    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv" event={"ID":"3f3a82a7-d1c7-40e1-8978-fd81253fc35e","Type":"ContainerDied","Data":"301f94574e0daec8873d7e6abfbd9b61c01e552465178dc9090dffda5a342628"}
Oct 30 20:58:18.783097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.783074    5115 scope.go:122] "RemoveContainer" containerID="1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"
Oct 30 20:58:18.783384 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:18.783364    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348\": container with ID starting with 1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348 not found: ID does not exist" containerID="1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"
Oct 30 20:58:18.783437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.783392    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348"} err="failed to get container status \"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348\": rpc error: code = NotFound desc = could not find container \"1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348\": container with ID starting with 1ca7a15629a4ec145494207ce3b11f28b3b7f06e4dcee88079332700fea32348 not found: ID does not exist"
Oct 30 20:58:18.783437 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.783411    5115 scope.go:122] "RemoveContainer" containerID="f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"
Oct 30 20:58:18.793686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.793656    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:58:18.798428 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.798311    5115 scope.go:122] "RemoveContainer" containerID="f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"
Oct 30 20:58:18.798654 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:18.798634    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30\": container with ID starting with f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30 not found: ID does not exist" containerID="f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"
Oct 30 20:58:18.798705 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.798662    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30"} err="failed to get container status \"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30\": rpc error: code = NotFound desc = could not find container \"f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30\": container with ID starting with f81c5c58a9d57375a2d53d44b991ac675660c343b390a26a78f3ddf792ad6c30 not found: ID does not exist"
Oct 30 20:58:18.839112 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.837642    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ad7ff0-fbdc9d878-hcnqv"]
Oct 30 20:58:18.869605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.864642    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:58:18.876064 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:18.876033    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ad7ff0-778dbb546c-tsbj4"]
Oct 30 20:58:20.386115 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.386074    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" path="/var/lib/kubelet/pods/3f3a82a7-d1c7-40e1-8978-fd81253fc35e/volumes"
Oct 30 20:58:20.386816 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.386794    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7caade46-7205-4e71-976e-444d0d394630" path="/var/lib/kubelet/pods/7caade46-7205-4e71-976e-444d0d394630/volumes"
Oct 30 20:58:20.400442 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.400413    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:58:20.400912 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.400880    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" containerID="cri-o://708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f" gracePeriod=30
Oct 30 20:58:20.413125 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.413097    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:58:20.413536 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.413494    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy" containerID="cri-o://e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa" gracePeriod=30
Oct 30 20:58:20.437824 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.437795    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:58:20.439338 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:20.439301    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" containerID="cri-o://f1635e473455bfbaf5bb1db8c7df10e0aef67cdd262e417f5bdb3ab506f63a4b" gracePeriod=30
Oct 30 20:58:21.571575 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.568424    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:58:21.625079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.625055    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:58:21.677630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.677596    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\" (UniqueName: \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\") pod \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") "
Oct 30 20:58:21.677862 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.677681    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\") pod \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\" (UID: \"093c40d9-68c1-4f4f-b787-542ceba1a0e4\") "
Oct 30 20:58:21.685296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.679140    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume" pod "093c40d9-68c1-4f4f-b787-542ceba1a0e4" (UID: "093c40d9-68c1-4f4f-b787-542ceba1a0e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:21.685296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.681913    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s" pod "093c40d9-68c1-4f4f-b787-542ceba1a0e4" (UID: "093c40d9-68c1-4f4f-b787-542ceba1a0e4"). InnerVolumeSpecName "kube-api-access-nk78s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:21.779455 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.779424    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\" (UniqueName: \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\") pod \"ba2ce495-e87a-4832-b25b-e6839444a1d6\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") "
Oct 30 20:58:21.779655 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.779463    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\") pod \"ba2ce495-e87a-4832-b25b-e6839444a1d6\" (UID: \"ba2ce495-e87a-4832-b25b-e6839444a1d6\") "
Oct 30 20:58:21.779866 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.779841    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume" pod "ba2ce495-e87a-4832-b25b-e6839444a1d6" (UID: "ba2ce495-e87a-4832-b25b-e6839444a1d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:21.780216 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.780196    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk78s\" (UniqueName: \"kubernetes.io/projected/093c40d9-68c1-4f4f-b787-542ceba1a0e4-kube-api-access-nk78s\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:21.780286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.780220    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c40d9-68c1-4f4f-b787-542ceba1a0e4-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:21.780286 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.780235    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba2ce495-e87a-4832-b25b-e6839444a1d6-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:21.781535 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.781497    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj" pod "ba2ce495-e87a-4832-b25b-e6839444a1d6" (UID: "ba2ce495-e87a-4832-b25b-e6839444a1d6"). InnerVolumeSpecName "kube-api-access-v4nhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:21.800405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.800342    5115 generic.go:356] "Generic (PLEG): container finished" podID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerID="de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0" exitCode=0
Oct 30 20:58:21.800405 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.800387    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"
Oct 30 20:58:21.800614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.800408    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" event={"ID":"093c40d9-68c1-4f4f-b787-542ceba1a0e4","Type":"ContainerDied","Data":"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"}
Oct 30 20:58:21.800614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.800459    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs" event={"ID":"093c40d9-68c1-4f4f-b787-542ceba1a0e4","Type":"ContainerDied","Data":"e415ad987e6cd25ac962cf50b9711448a845f82b2d8dbb78f47f0da5c341235c"}
Oct 30 20:58:21.800614 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.800490    5115 scope.go:122] "RemoveContainer" containerID="de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"
Oct 30 20:58:21.801931 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.801908    5115 generic.go:356] "Generic (PLEG): container finished" podID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerID="9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2" exitCode=0
Oct 30 20:58:21.802006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.801951    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"
Oct 30 20:58:21.802006 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.801985    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" event={"ID":"ba2ce495-e87a-4832-b25b-e6839444a1d6","Type":"ContainerDied","Data":"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"}
Oct 30 20:58:21.802076 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.802039    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x" event={"ID":"ba2ce495-e87a-4832-b25b-e6839444a1d6","Type":"ContainerDied","Data":"0ee2bff12d1a329a10b08bf40f8c052293afddd5d6a270124dfe6ef9c67e40a8"}
Oct 30 20:58:21.811418 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.811357    5115 scope.go:122] "RemoveContainer" containerID="de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"
Oct 30 20:58:21.811731 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:21.811702    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0\": container with ID starting with de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0 not found: ID does not exist" containerID="de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"
Oct 30 20:58:21.811812 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.811734    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0"} err="failed to get container status \"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0\": rpc error: code = NotFound desc = could not find container \"de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0\": container with ID starting with de5f40a0e5fe2bb6228aebce79778e47d906879ca1bb82845e21a7dbfafa94e0 not found: ID does not exist"
Oct 30 20:58:21.811812 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.811758    5115 scope.go:122] "RemoveContainer" containerID="9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"
Oct 30 20:58:21.820962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.820945    5115 scope.go:122] "RemoveContainer" containerID="9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"
Oct 30 20:58:21.821232 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:21.821212    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2\": container with ID starting with 9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2 not found: ID does not exist" containerID="9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"
Oct 30 20:58:21.821299 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.821243    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2"} err="failed to get container status \"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2\": rpc error: code = NotFound desc = could not find container \"9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2\": container with ID starting with 9b3a443326c01c8c87a2e1b0914d8a99acc18c323cd2ab80b8742d3d5c949ec2 not found: ID does not exist"
Oct 30 20:58:21.826940 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.826917    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:58:21.832688 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.832664    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cb60a2-68f857b59f-7cvxs"]
Oct 30 20:58:21.849820 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.849795    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:58:21.853411 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.853392    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-cb60a2-668d7b9d7b-vk97x"]
Oct 30 20:58:21.881978 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:21.881949    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4nhj\" (UniqueName: \"kubernetes.io/projected/ba2ce495-e87a-4832-b25b-e6839444a1d6-kube-api-access-v4nhj\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:22.370863 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:22.370828    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" path="/var/lib/kubelet/pods/093c40d9-68c1-4f4f-b787-542ceba1a0e4/volumes"
Oct 30 20:58:22.371319 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:22.371304    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" path="/var/lib/kubelet/pods/ba2ce495-e87a-4832-b25b-e6839444a1d6/volumes"
Oct 30 20:58:24.476698 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.476665    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:58:24.477280 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.476933    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" containerID="cri-o://bc07f9455a4c4d75890cf196d5d885c44b993eef2c3d1c70163f1030ef3bd6b7" gracePeriod=30
Oct 30 20:58:24.482799 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.482776    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:58:24.482999 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.482974    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" containerID="cri-o://17c077cf9a71ea33282e4ca191c7ff9805d1fd9962e4a2914e1cf13173397617" gracePeriod=30
Oct 30 20:58:24.493744 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.493716    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:58:24.493956 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:24.493921    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" containerID="cri-o://a3478006da9c9e3a78e4cbaeced63ea00d317141e0f6cabff3349ef40fc01410" gracePeriod=30
Oct 30 20:58:25.395517 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.395481    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:58:25.395724 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.395581    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:58:25.791574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.782929    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:58:25.844028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.843993    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:58:25.847936 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.847910    5115 generic.go:356] "Generic (PLEG): container finished" podID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerID="e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa" exitCode=0
Oct 30 20:58:25.848097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.847955    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"
Oct 30 20:58:25.848097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.847994    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" event={"ID":"ddc5d32c-308c-4205-8d75-8d25907a52c4","Type":"ContainerDied","Data":"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"}
Oct 30 20:58:25.848097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.848049    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft" event={"ID":"ddc5d32c-308c-4205-8d75-8d25907a52c4","Type":"ContainerDied","Data":"bc431d9b2c2c191d919b5e74ba784b2d85e19c25a6d792f9fb9fe7aa45bc16ee"}
Oct 30 20:58:25.848097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.848078    5115 scope.go:122] "RemoveContainer" containerID="e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"
Oct 30 20:58:25.850296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.850268    5115 generic.go:356] "Generic (PLEG): container finished" podID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerID="f1635e473455bfbaf5bb1db8c7df10e0aef67cdd262e417f5bdb3ab506f63a4b" exitCode=0
Oct 30 20:58:25.850446 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.850298    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" event={"ID":"03d1f441-e639-4ae2-85f8-f4556b916c4d","Type":"ContainerDied","Data":"f1635e473455bfbaf5bb1db8c7df10e0aef67cdd262e417f5bdb3ab506f63a4b"}
Oct 30 20:58:25.852114 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.852091    5115 generic.go:356] "Generic (PLEG): container finished" podID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerID="708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f" exitCode=0
Oct 30 20:58:25.852369 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.852349    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" event={"ID":"b6d227f8-3db0-4563-bdaa-9a400c817748","Type":"ContainerDied","Data":"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"}
Oct 30 20:58:25.852592 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.852572    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" event={"ID":"b6d227f8-3db0-4563-bdaa-9a400c817748","Type":"ContainerDied","Data":"1e322cb0ebb8973fe7e833604e8d2521eec6abcaedacba2960c40adf6856d3dc"}
Oct 30 20:58:25.852813 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.852798    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"
Oct 30 20:58:25.862429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.862409    5115 scope.go:122] "RemoveContainer" containerID="e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"
Oct 30 20:58:25.862828 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:25.862798    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa\": container with ID starting with e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa not found: ID does not exist" containerID="e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"
Oct 30 20:58:25.862924 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.862835    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa"} err="failed to get container status \"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa\": rpc error: code = NotFound desc = could not find container \"e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa\": container with ID starting with e26f5392eec69be5a3a98ea18467f6e4484e5c15e601686f76bb4eb928e267fa not found: ID does not exist"
Oct 30 20:58:25.862924 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.862853    5115 scope.go:122] "RemoveContainer" containerID="708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883197    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883250    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883302    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883337    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883368    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883433    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883489    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.883725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.883600    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.885866    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.885928    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886015    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886085    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886127    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886161    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886202    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886244    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\") pod \"b6d227f8-3db0-4563-bdaa-9a400c817748\" (UID: \"b6d227f8-3db0-4563-bdaa-9a400c817748\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886338    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.886368    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\") pod \"ddc5d32c-308c-4205-8d75-8d25907a52c4\" (UID: \"ddc5d32c-308c-4205-8d75-8d25907a52c4\") "
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.887376    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.887627    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.887869    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.888602 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.888106    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.892962 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.892941    5115 scope.go:122] "RemoveContainer" containerID="708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"
Oct 30 20:58:25.894915 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:25.894890    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f\": container with ID starting with 708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f not found: ID does not exist" containerID="708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"
Oct 30 20:58:25.895028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.894919    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f"} err="failed to get container status \"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f\": rpc error: code = NotFound desc = could not find container \"708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f\": container with ID starting with 708dfb90c938066c22fe35761a230e1a2e690c09e99df5acb8f956aa8d1ba70f not found: ID does not exist"
Oct 30 20:58:25.895725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.895116    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.895725 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.895391    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:25.895883 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.895737    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:25.897270 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.896759    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:25.897270 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.896999    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.898174 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.897814    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.899088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.898734    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.905105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.903477    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.905105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.903823    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "kube-api-access-9lx8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:25.905105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.903898    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:25.905105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.903966    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:25.905105 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.904790    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm" pod "b6d227f8-3db0-4563-bdaa-9a400c817748" (UID: "b6d227f8-3db0-4563-bdaa-9a400c817748"). InnerVolumeSpecName "kube-api-access-djtvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:25.909346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.909166    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:25.909346 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.909260    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo" pod "ddc5d32c-308c-4205-8d75-8d25907a52c4" (UID: "ddc5d32c-308c-4205-8d75-8d25907a52c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:25.927578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.920800    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:58:25.927578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.920994    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:58:25.988588 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988510    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d227f8-3db0-4563-bdaa-9a400c817748-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988588 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988587    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988598    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988606    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988616    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988625    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lx8j\" (UniqueName: \"kubernetes.io/projected/ddc5d32c-308c-4205-8d75-8d25907a52c4-kube-api-access-9lx8j\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988643    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988652    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988661    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988669    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988677    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988685    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988694    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988702    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988712    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djtvm\" (UniqueName: \"kubernetes.io/projected/b6d227f8-3db0-4563-bdaa-9a400c817748-kube-api-access-djtvm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988720    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc5d32c-308c-4205-8d75-8d25907a52c4-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988730    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc5d32c-308c-4205-8d75-8d25907a52c4-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:25.988775 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:25.988738    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d227f8-3db0-4563-bdaa-9a400c817748-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.109686 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.109659    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:58:26.179604 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.179576    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:58:26.184747 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.184718    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-467ft"]
Oct 30 20:58:26.191750 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.191710    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.191897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.191773    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.191897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.191814    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.191897 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.191859    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192062 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.191966    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192062 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192038    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192185 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192166    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192398 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192380    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192570 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192541    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:26.192669 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192568    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\") pod \"03d1f441-e639-4ae2-85f8-f4556b916c4d\" (UID: \"03d1f441-e639-4ae2-85f8-f4556b916c4d\") "
Oct 30 20:58:26.192874 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.192851    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:26.193354 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.193297    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.193842 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.193825    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03d1f441-e639-4ae2-85f8-f4556b916c4d-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.194578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.193711    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:26.194578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.193776    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:26.194578 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.193904    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:26.195913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.195871    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:26.195913 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.195902    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "kube-api-access-wn5nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:26.196650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.196620    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:58:26.197024 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.196999    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:26.197402 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.197366    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy" pod "03d1f441-e639-4ae2-85f8-f4556b916c4d" (UID: "03d1f441-e639-4ae2-85f8-f4556b916c4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:26.207860 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.207839    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l"]
Oct 30 20:58:26.249305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.248888    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:58:26.249305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.248966    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:58:26.296245 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296210    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn5nv\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-kube-api-access-wn5nv\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296245 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296243    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296258    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296272    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296285    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296296    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03d1f441-e639-4ae2-85f8-f4556b916c4d-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.296474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.296308    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03d1f441-e639-4ae2-85f8-f4556b916c4d-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:26.369160 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.369126    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" path="/var/lib/kubelet/pods/b6d227f8-3db0-4563-bdaa-9a400c817748/volumes"
Oct 30 20:58:26.369676 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.369662    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" path="/var/lib/kubelet/pods/ddc5d32c-308c-4205-8d75-8d25907a52c4/volumes"
Oct 30 20:58:26.709237 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.709198    5115 patch_prober.go:29] interesting pod/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:58:26.709436 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.709276    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-sr25l" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:58:26.783140 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.783104    5115 patch_prober.go:29] interesting pod/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:58:26.783337 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.783169    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:58:26.863573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.863543    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"
Oct 30 20:58:26.863573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.863514    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx" event={"ID":"03d1f441-e639-4ae2-85f8-f4556b916c4d","Type":"ContainerDied","Data":"a72fd07b5de21f12df6724254db337c9ccd709cee33a0ee9df77ca9e4631c88e"}
Oct 30 20:58:26.864083 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.863615    5115 scope.go:122] "RemoveContainer" containerID="f1635e473455bfbaf5bb1db8c7df10e0aef67cdd262e417f5bdb3ab506f63a4b"
Oct 30 20:58:26.881289 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.881258    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:58:26.886034 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:26.886000    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ad7ff0-openshift-default-6f59db585c-7bfmx"]
Oct 30 20:58:28.380113 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:28.379943    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" path="/var/lib/kubelet/pods/03d1f441-e639-4ae2-85f8-f4556b916c4d/volumes"
Oct 30 20:58:30.221048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.181350    5115 generic.go:356] "Generic (PLEG): container finished" podID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerID="a3478006da9c9e3a78e4cbaeced63ea00d317141e0f6cabff3349ef40fc01410" exitCode=0
Oct 30 20:58:30.221048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.181625    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" event={"ID":"1c6b4bf7-b270-4962-99d8-1ba5fd227745","Type":"ContainerDied","Data":"a3478006da9c9e3a78e4cbaeced63ea00d317141e0f6cabff3349ef40fc01410"}
Oct 30 20:58:30.221048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.219485    5115 generic.go:356] "Generic (PLEG): container finished" podID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerID="bc07f9455a4c4d75890cf196d5d885c44b993eef2c3d1c70163f1030ef3bd6b7" exitCode=0
Oct 30 20:58:30.221048 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.219801    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" event={"ID":"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb","Type":"ContainerDied","Data":"bc07f9455a4c4d75890cf196d5d885c44b993eef2c3d1c70163f1030ef3bd6b7"}
Oct 30 20:58:30.244550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.223103    5115 generic.go:356] "Generic (PLEG): container finished" podID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerID="17c077cf9a71ea33282e4ca191c7ff9805d1fd9962e4a2914e1cf13173397617" exitCode=0
Oct 30 20:58:30.244550 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.223184    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" event={"ID":"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c","Type":"ContainerDied","Data":"17c077cf9a71ea33282e4ca191c7ff9805d1fd9962e4a2914e1cf13173397617"}
Oct 30 20:58:30.667234 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.666868    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:58:30.810074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810031    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810090    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810131    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810174    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810227    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810458 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810330    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810458 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810407    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810515    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.810609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.810575    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\") pod \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\" (UID: \"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c\") "
Oct 30 20:58:30.811656 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.811625    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:30.811948 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.811920    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:30.812141 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.812117    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:30.812331 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.812310    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:30.815607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.813179    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:30.815607 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.815074    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "kube-api-access-xqbjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:30.815961 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.815938    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:30.816889 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.816865    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:30.817741 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.817707    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy" pod "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" (UID: "3675e23a-9de5-4cf9-9d50-bccd61cf0f9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914612    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914654    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914672    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914685    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914700    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914715    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914729    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqbjx\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-kube-api-access-xqbjx\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914745    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.917713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.914758    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:30.937816 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.937461    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:58:30.957360 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:30.957259    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:58:31.015409 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015370    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.015624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015426    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.015624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015466    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.015624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015564    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.015624 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015620    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.015875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015652    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.015875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015762    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.015875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015795    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.015875 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015838    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.016079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015904    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.016079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015942    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.016079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.015998    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.016079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016030    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.016079 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016071    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.016334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016159    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.016334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016204    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\") pod \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\" (UID: \"1c6b4bf7-b270-4962-99d8-1ba5fd227745\") "
Oct 30 20:58:31.016334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016258    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.016334 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.016299    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\") pod \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\" (UID: \"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb\") "
Oct 30 20:58:31.017556 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.017507    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.018576 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.018548    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.018802 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.018780    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.019240 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.019214    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.019425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.019403    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.019748 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.019723    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:31.021636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.021603    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.035447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.032803    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.035447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.033147    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:31.035447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.033420    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.035447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.034158    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "kube-api-access-jhfdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:31.080217 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.080095    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.080663 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.080609    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "kube-api-access-v5pks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:31.080959 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.080917    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:31.081201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.081162    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:31.081456 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.081436    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:31.081878 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.081856    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token" pod "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" (UID: "f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:31.084268 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.084236    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo" pod "1c6b4bf7-b270-4962-99d8-1ba5fd227745" (UID: "1c6b4bf7-b270-4962-99d8-1ba5fd227745"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:31.118510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118475    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118508    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118510 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118517    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118557    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118565    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118574    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5pks\" (UniqueName: \"kubernetes.io/projected/1c6b4bf7-b270-4962-99d8-1ba5fd227745-kube-api-access-v5pks\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118584    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118593    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118602    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118610    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhfdd\" (UniqueName: \"kubernetes.io/projected/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-kube-api-access-jhfdd\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118617    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118626    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118634    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c6b4bf7-b270-4962-99d8-1ba5fd227745-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118642    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118650    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118660    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118668    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c6b4bf7-b270-4962-99d8-1ba5fd227745-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.118745 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.118676    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:31.234563 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.234494    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"
Oct 30 20:58:31.234563 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.234518    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc" event={"ID":"1c6b4bf7-b270-4962-99d8-1ba5fd227745","Type":"ContainerDied","Data":"a593da476bca8882d5f5b5a78abcea7b630b12c90054d67938fcbf9e1f9ef06e"}
Oct 30 20:58:31.235094 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.234602    5115 scope.go:122] "RemoveContainer" containerID="a3478006da9c9e3a78e4cbaeced63ea00d317141e0f6cabff3349ef40fc01410"
Oct 30 20:58:31.237896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.237873    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"
Oct 30 20:58:31.238502 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.238446    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm" event={"ID":"f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb","Type":"ContainerDied","Data":"d9243a9d84dd186c012413f44f06dffb743e01bd9a8d479783346a4295bdc35f"}
Oct 30 20:58:31.240681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.240632    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp" event={"ID":"3675e23a-9de5-4cf9-9d50-bccd61cf0f9c","Type":"ContainerDied","Data":"4b6b06fdaf408626847e5087450c49e594c1e8a83fd7647e90fd4d84eb674771"}
Oct 30 20:58:31.240796 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.240698    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"
Oct 30 20:58:31.261995 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.261965    5115 scope.go:122] "RemoveContainer" containerID="bc07f9455a4c4d75890cf196d5d885c44b993eef2c3d1c70163f1030ef3bd6b7"
Oct 30 20:58:31.281838 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.281799    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:58:31.282223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.282192    5115 scope.go:122] "RemoveContainer" containerID="17c077cf9a71ea33282e4ca191c7ff9805d1fd9962e4a2914e1cf13173397617"
Oct 30 20:58:31.291256 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.291228    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-rnttc"]
Oct 30 20:58:31.312769 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.312728    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:58:31.319139 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.319112    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-cwxcm"]
Oct 30 20:58:31.337305 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.337226    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:58:31.343731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:31.343702    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cb60a2-openshift-default-57db98bd79-wzhvp"]
Oct 30 20:58:32.369708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:32.369678    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" path="/var/lib/kubelet/pods/1c6b4bf7-b270-4962-99d8-1ba5fd227745/volumes"
Oct 30 20:58:32.370195 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:32.370175    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" path="/var/lib/kubelet/pods/3675e23a-9de5-4cf9-9d50-bccd61cf0f9c/volumes"
Oct 30 20:58:32.370641 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:32.370627    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" path="/var/lib/kubelet/pods/f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb/volumes"
Oct 30 20:58:36.280469 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:36.280432    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:58:38.583918 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:38.583883    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:58:43.839926 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:43.839894    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:58:43.848088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:43.848058    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:58:48.841276 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:48.841221    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing" containerID="cri-o://f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45" gracePeriod=25
Oct 30 20:58:48.849263 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:48.849201    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing" containerID="cri-o://fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7" gracePeriod=25
Oct 30 20:58:53.606280 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.606219    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" containerID="cri-o://77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123" gracePeriod=45
Oct 30 20:58:53.670117 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.670075    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": dial tcp 10.132.0.92:8000: connect: connection refused"
Oct 30 20:58:53.910356 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.910326    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:58:53.973735 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.973705    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.973950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.973746    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\" (UniqueName: \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.973950 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.973910    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\" (UniqueName: \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.974061 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.973976    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.974061 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974018    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.974061 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974055    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\") pod \"466a6754-77ac-4419-aca9-6e9f556c0d8a\" (UID: \"466a6754-77ac-4419-aca9-6e9f556c0d8a\") "
Oct 30 20:58:53.974202 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974049    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:53.974301 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974278    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:53.974414 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974395    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:53.974708 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974688    5115 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-model-cache\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:53.974822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974711    5115 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-home\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:53.974822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.974728    5115 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-tmp-dir\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:53.976487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.976462    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:53.976784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.976762    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "kube-api-access-h59rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:53.977679 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:53.977651    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs" pod "466a6754-77ac-4419-aca9-6e9f556c0d8a" (UID: "466a6754-77ac-4419-aca9-6e9f556c0d8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:54.075738 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.075706    5115 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466a6754-77ac-4419-aca9-6e9f556c0d8a-tls-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:54.075738 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.075736    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h59rq\" (UniqueName: \"kubernetes.io/projected/466a6754-77ac-4419-aca9-6e9f556c0d8a-kube-api-access-h59rq\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:54.075939 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.075751    5115 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466a6754-77ac-4419-aca9-6e9f556c0d8a-dshm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:58:54.435635 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.435598    5115 generic.go:356] "Generic (PLEG): container finished" podID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerID="77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123" exitCode=0
Oct 30 20:58:54.435823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.435645    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"
Oct 30 20:58:54.435823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.435663    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" event={"ID":"466a6754-77ac-4419-aca9-6e9f556c0d8a","Type":"ContainerDied","Data":"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"}
Oct 30 20:58:54.435823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.435718    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr" event={"ID":"466a6754-77ac-4419-aca9-6e9f556c0d8a","Type":"ContainerDied","Data":"5053528c99d115e4db9239357ad1f2c55d12cde4d57673e8c7539f9c3eb93def"}
Oct 30 20:58:54.435823 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.435739    5115 scope.go:122] "RemoveContainer" containerID="77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"
Oct 30 20:58:54.449639 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.449613    5115 scope.go:122] "RemoveContainer" containerID="77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"
Oct 30 20:58:54.449982 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:58:54.449963    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123\": container with ID starting with 77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123 not found: ID does not exist" containerID="77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"
Oct 30 20:58:54.450069 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.449993    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123"} err="failed to get container status \"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123\": rpc error: code = NotFound desc = could not find container \"77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123\": container with ID starting with 77b74ceeba8d53a120b5bbae019e22588dfcca798dd0b9a14f3ba5d061c30123 not found: ID does not exist"
Oct 30 20:58:54.459713 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.459680    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:58:54.465751 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:54.465725    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-14cca2/distinct-2-w5-14cca2-kserve-799bbdcb79-8vbbr"]
Oct 30 20:58:56.157896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:56.157853    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:56.157896 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:56.157877    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:58:56.369052 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:56.369017    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" path="/var/lib/kubelet/pods/466a6754-77ac-4419-aca9-6e9f556c0d8a/volumes"
Oct 30 20:58:59.125054 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:59.125029    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:58:59.253876 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:58:59.253848    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 20:59:00.717871 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:00.717831    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:59:00.718361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:00.718084    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" podUID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" containerName="maas-api" containerID="cri-o://6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9" gracePeriod=30
Oct 30 20:59:01.120753 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.120714    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:59:01.210419 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.210383    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\") pod \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") "
Oct 30 20:59:01.210648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.210436    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\") pod \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") "
Oct 30 20:59:01.210648 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.210563    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\" (UniqueName: \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\") pod \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") "
Oct 30 20:59:01.210826 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.210810    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") pod \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\" (UID: \"90b0fbc0-47f7-4645-96e9-8705b279e7eb\") "
Oct 30 20:59:01.211179 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.210903    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca" pod "90b0fbc0-47f7-4645-96e9-8705b279e7eb" (UID: "90b0fbc0-47f7-4645-96e9-8705b279e7eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:01.211569 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.211337    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b0fbc0-47f7-4645-96e9-8705b279e7eb-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:01.212974 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.212949    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6" pod "90b0fbc0-47f7-4645-96e9-8705b279e7eb" (UID: "90b0fbc0-47f7-4645-96e9-8705b279e7eb"). InnerVolumeSpecName "kube-api-access-2b2q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:01.213361 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.213341    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls" pod "90b0fbc0-47f7-4645-96e9-8705b279e7eb" (UID: "90b0fbc0-47f7-4645-96e9-8705b279e7eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:01.213616 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.213589    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs" pod "90b0fbc0-47f7-4645-96e9-8705b279e7eb" (UID: "90b0fbc0-47f7-4645-96e9-8705b279e7eb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:01.321258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.321160    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:01.321258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.321200    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90b0fbc0-47f7-4645-96e9-8705b279e7eb-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:01.321258 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.321218    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b2q6\" (UniqueName: \"kubernetes.io/projected/90b0fbc0-47f7-4645-96e9-8705b279e7eb-kube-api-access-2b2q6\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:01.490988 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.490942    5115 generic.go:356] "Generic (PLEG): container finished" podID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" containerID="6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9" exitCode=0
Oct 30 20:59:01.490988 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.490993    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"
Oct 30 20:59:01.491273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.491050    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" event={"ID":"90b0fbc0-47f7-4645-96e9-8705b279e7eb","Type":"ContainerDied","Data":"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"}
Oct 30 20:59:01.491273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.491119    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r" event={"ID":"90b0fbc0-47f7-4645-96e9-8705b279e7eb","Type":"ContainerDied","Data":"584537b2a0d4b1978309fb026b01dd05eeef03c47c37eef032a324f0b1f54f1c"}
Oct 30 20:59:01.491273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.491157    5115 scope.go:122] "RemoveContainer" containerID="6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"
Oct 30 20:59:01.503732 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.503704    5115 scope.go:122] "RemoveContainer" containerID="6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"
Oct 30 20:59:01.504058 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:01.504033    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9\": container with ID starting with 6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9 not found: ID does not exist" containerID="6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"
Oct 30 20:59:01.504145 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.504071    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9"} err="failed to get container status \"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9\": rpc error: code = NotFound desc = could not find container \"6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9\": container with ID starting with 6d028bd46b24c537d1d69069f9788625619530408c54dda5c9bae0a02af3c1d9 not found: ID does not exist"
Oct 30 20:59:01.515172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.515147    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:59:01.527783 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:01.527749    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-14cca2-778d5f4776-gz59r"]
Oct 30 20:59:02.370723 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:02.370688    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" path="/var/lib/kubelet/pods/90b0fbc0-47f7-4645-96e9-8705b279e7eb/volumes"
Oct 30 20:59:06.158065 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:06.158030    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:59:06.158065 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:06.158058    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:59:06.281165 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:06.281128    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:59:09.165746 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.165714    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:59:09.166574 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.166469    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" containerID="cri-o://70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc" gracePeriod=30
Oct 30 20:59:09.173635 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.173612    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:59:09.174118 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.174096    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:59:09.174302 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.174280    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy" containerID="cri-o://fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a" gracePeriod=30
Oct 30 20:59:09.178349 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.178323    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:59:09.178608 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.178564    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" containerID="cri-o://4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5" gracePeriod=30
Oct 30 20:59:09.191853 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.191834    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:59:09.264605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.264566    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\" (UniqueName: \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\") pod \"651a897a-5eea-4634-9154-daf3587636ef\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") "
Oct 30 20:59:09.265389 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.265362    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\") pod \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") "
Oct 30 20:59:09.265819 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.265795    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\") pod \"651a897a-5eea-4634-9154-daf3587636ef\" (UID: \"651a897a-5eea-4634-9154-daf3587636ef\") "
Oct 30 20:59:09.266682 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.266310    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume" pod "651a897a-5eea-4634-9154-daf3587636ef" (UID: "651a897a-5eea-4634-9154-daf3587636ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:09.266993 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.266971    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume" pod "4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" (UID: "4de48d20-0a7b-46b9-ba54-2f0563a6b5ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:09.268284 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.267208    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\" (UniqueName: \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\") pod \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\" (UID: \"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad\") "
Oct 30 20:59:09.269687 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.269662    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:09.270616 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.270598    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/651a897a-5eea-4634-9154-daf3587636ef-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:09.276919 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.276891    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs" pod "4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" (UID: "4de48d20-0a7b-46b9-ba54-2f0563a6b5ad"). InnerVolumeSpecName "kube-api-access-qsvqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:09.277569 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.277504    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2" pod "651a897a-5eea-4634-9154-daf3587636ef" (UID: "651a897a-5eea-4634-9154-daf3587636ef"). InnerVolumeSpecName "kube-api-access-5v7j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:09.372565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.372436    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsvqs\" (UniqueName: \"kubernetes.io/projected/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad-kube-api-access-qsvqs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:09.372565 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.372468    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v7j2\" (UniqueName: \"kubernetes.io/projected/651a897a-5eea-4634-9154-daf3587636ef-kube-api-access-5v7j2\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:09.560078 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.560040    5115 generic.go:356] "Generic (PLEG): container finished" podID="651a897a-5eea-4634-9154-daf3587636ef" containerID="fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7" exitCode=0
Oct 30 20:59:09.560078 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.560080    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"
Oct 30 20:59:09.560296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.560113    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" event={"ID":"651a897a-5eea-4634-9154-daf3587636ef","Type":"ContainerDied","Data":"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"}
Oct 30 20:59:09.560296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.560163    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f" event={"ID":"651a897a-5eea-4634-9154-daf3587636ef","Type":"ContainerDied","Data":"8a6c511acbf8597cbb12996cd7881ad5e48e0e19e04d05a2e92b23282b7567c0"}
Oct 30 20:59:09.560296 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.560185    5115 scope.go:122] "RemoveContainer" containerID="fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"
Oct 30 20:59:09.562074 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.562048    5115 generic.go:356] "Generic (PLEG): container finished" podID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerID="f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45" exitCode=0
Oct 30 20:59:09.562198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.562082    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"
Oct 30 20:59:09.562198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.562108    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" event={"ID":"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad","Type":"ContainerDied","Data":"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"}
Oct 30 20:59:09.562198 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.562147    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9" event={"ID":"4de48d20-0a7b-46b9-ba54-2f0563a6b5ad","Type":"ContainerDied","Data":"43e802e460d7150637ada08a22a8f9147b17cb1861bdfc24d4b82f2e92553e52"}
Oct 30 20:59:09.587987 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.586897    5115 scope.go:122] "RemoveContainer" containerID="fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"
Oct 30 20:59:09.590682 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:09.589037    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7\": container with ID starting with fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7 not found: ID does not exist" containerID="fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"
Oct 30 20:59:09.590682 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.589079    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7"} err="failed to get container status \"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7\": rpc error: code = NotFound desc = could not find container \"fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7\": container with ID starting with fc253de78bd97be67c232715ce3f88d4009928b10b72ee90afe58438e5dc4ef7 not found: ID does not exist"
Oct 30 20:59:09.590682 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.589105    5115 scope.go:122] "RemoveContainer" containerID="f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"
Oct 30 20:59:09.603760 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.603735    5115 scope.go:122] "RemoveContainer" containerID="f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"
Oct 30 20:59:09.609980 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:09.609161    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45\": container with ID starting with f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45 not found: ID does not exist" containerID="f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"
Oct 30 20:59:09.610186 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.610007    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45"} err="failed to get container status \"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45\": rpc error: code = NotFound desc = could not find container \"f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45\": container with ID starting with f3f75fcaa847908f9f1fb69bf49c3a22c3b6129e5e81597c2ac2149f13fbec45 not found: ID does not exist"
Oct 30 20:59:09.612822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.612790    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:59:09.616704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.616674    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-14cca2-5bbdc96455-xjx9f"]
Oct 30 20:59:09.624154 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.624109    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:59:09.628948 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:09.628927    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-14cca2-596f685676-r8wg9"]
Oct 30 20:59:10.369005 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:10.368973    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" path="/var/lib/kubelet/pods/4de48d20-0a7b-46b9-ba54-2f0563a6b5ad/volumes"
Oct 30 20:59:10.369419 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:10.369404    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="651a897a-5eea-4634-9154-daf3587636ef" path="/var/lib/kubelet/pods/651a897a-5eea-4634-9154-daf3587636ef/volumes"
Oct 30 20:59:10.552621 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:10.552589    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:59:10.552821 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:10.552651    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:59:11.520029 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:11.519993    5115 patch_prober.go:29] interesting pod/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:59:11.520402 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:11.520056    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:59:14.502512 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.502482    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:59:14.602714 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.602688    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:59:14.604568 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.604519    5115 generic.go:356] "Generic (PLEG): container finished" podID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerID="70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc" exitCode=0
Oct 30 20:59:14.604704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.604671    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" event={"ID":"df86b921-4cd5-4d32-8de0-b7eedfde295b","Type":"ContainerDied","Data":"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"}
Oct 30 20:59:14.604752 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.604722    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn" event={"ID":"df86b921-4cd5-4d32-8de0-b7eedfde295b","Type":"ContainerDied","Data":"0bf45a48a2053e3a4af62b89e275e08dab75a6fcafa095810edf0ddcd9050b55"}
Oct 30 20:59:14.604786 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.604751    5115 scope.go:122] "RemoveContainer" containerID="70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"
Oct 30 20:59:14.604889 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.604871    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"
Oct 30 20:59:14.605016 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.605002    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:59:14.606722 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.606695    5115 generic.go:356] "Generic (PLEG): container finished" podID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerID="4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5" exitCode=0
Oct 30 20:59:14.606830 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.606729    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" event={"ID":"5bed789a-d64d-4811-b031-d7e9647dc93d","Type":"ContainerDied","Data":"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"}
Oct 30 20:59:14.606892 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.606866    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v" event={"ID":"5bed789a-d64d-4811-b031-d7e9647dc93d","Type":"ContainerDied","Data":"ac336e8cab8743f433819bde10e03244fd7feceae388873a2dcc017c5e29bb64"}
Oct 30 20:59:14.609123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.609100    5115 generic.go:356] "Generic (PLEG): container finished" podID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerID="fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a" exitCode=0
Oct 30 20:59:14.609355 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.609334    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" event={"ID":"70bb2791-9cc4-4ad5-8116-76bac4ad8b02","Type":"ContainerDied","Data":"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"}
Oct 30 20:59:14.609453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.609381    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8" event={"ID":"70bb2791-9cc4-4ad5-8116-76bac4ad8b02","Type":"ContainerDied","Data":"3d423299c89276c1714c501c79888d0acb5d76f3271b1ef7b85f96fcf8aa1d18"}
Oct 30 20:59:14.609453 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.609449    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"
Oct 30 20:59:14.617921 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.617902    5115 scope.go:122] "RemoveContainer" containerID="70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"
Oct 30 20:59:14.618186 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:14.618159    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc\": container with ID starting with 70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc not found: ID does not exist" containerID="70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"
Oct 30 20:59:14.618247 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.618193    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc"} err="failed to get container status \"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc\": rpc error: code = NotFound desc = could not find container \"70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc\": container with ID starting with 70fc2fcac989ce4ea80dc4a9addecf46609f42eb6e0d1996d93feab14abc2bbc not found: ID does not exist"
Oct 30 20:59:14.618247 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.618210    5115 scope.go:122] "RemoveContainer" containerID="4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"
Oct 30 20:59:14.634731 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.634712    5115 scope.go:122] "RemoveContainer" containerID="4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"
Oct 30 20:59:14.635088 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:14.635062    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5\": container with ID starting with 4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5 not found: ID does not exist" containerID="4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"
Oct 30 20:59:14.635231 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.635208    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5"} err="failed to get container status \"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5\": rpc error: code = NotFound desc = could not find container \"4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5\": container with ID starting with 4f88f9451f12de22ae1e6c19304a0a98a4dccdde040a1bd21910e50834f5aef5 not found: ID does not exist"
Oct 30 20:59:14.635344 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.635333    5115 scope.go:122] "RemoveContainer" containerID="fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"
Oct 30 20:59:14.645784 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.645759    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.645890 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.645815    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.645890 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.645848    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646019 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.645945    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646019 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.645987    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646121 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646051    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646177 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646146    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646235    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646272    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\") pod \"df86b921-4cd5-4d32-8de0-b7eedfde295b\" (UID: \"df86b921-4cd5-4d32-8de0-b7eedfde295b\") "
Oct 30 20:59:14.646429 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646298    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.646619 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646425    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.646734 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646712    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:14.647123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.646917    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.647123 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.647064    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.647307 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.647254    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.647307 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.647278    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.647307 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.647291    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86b921-4cd5-4d32-8de0-b7eedfde295b-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.647763 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.647739    5115 scope.go:122] "RemoveContainer" containerID="fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"
Oct 30 20:59:14.648336 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:14.648274    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a\": container with ID starting with fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a not found: ID does not exist" containerID="fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"
Oct 30 20:59:14.648336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.648310    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a"} err="failed to get container status \"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a\": rpc error: code = NotFound desc = could not find container \"fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a\": container with ID starting with fe2ae0ff5737c6f815e6ffaab122610fa45a4e4bd385daf07db8727741306a5a not found: ID does not exist"
Oct 30 20:59:14.649110 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.649088    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "kube-api-access-hx5lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.649223 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.649204    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.650785 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.650756    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:14.656244 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.656216    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token" pod "df86b921-4cd5-4d32-8de0-b7eedfde295b" (UID: "df86b921-4cd5-4d32-8de0-b7eedfde295b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.748404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748324    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.748404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748365    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.748404 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748388    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748409    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748540    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748599    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748641    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748671    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748660    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748689    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.748727 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748722    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748731    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748863    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.748972    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749029    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749097    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749159    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.749172 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749164    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749206    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749219    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749235    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749265    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749304    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749344    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\") pod \"5bed789a-d64d-4811-b031-d7e9647dc93d\" (UID: \"5bed789a-d64d-4811-b031-d7e9647dc93d\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749422    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\") pod \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\" (UID: \"70bb2791-9cc4-4ad5-8116-76bac4ad8b02\") "
Oct 30 20:59:14.749558 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.749439    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750248    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750277    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750290    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750304    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750320    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750335    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx5lr\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-kube-api-access-hx5lr\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750349    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bed789a-d64d-4811-b031-d7e9647dc93d-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750364    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750376    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750387    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750401    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86b921-4cd5-4d32-8de0-b7eedfde295b-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750415    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750428    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.750636 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750441    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86b921-4cd5-4d32-8de0-b7eedfde295b-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.750808    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751138    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751392    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751485    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751499    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:14.751941 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751820    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "kube-api-access-gnz8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.752336 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.751997    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:14.752609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.752587    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.752807 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.752789    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token" pod "70bb2791-9cc4-4ad5-8116-76bac4ad8b02" (UID: "70bb2791-9cc4-4ad5-8116-76bac4ad8b02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.753287 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.753269    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z" pod "5bed789a-d64d-4811-b031-d7e9647dc93d" (UID: "5bed789a-d64d-4811-b031-d7e9647dc93d"). InnerVolumeSpecName "kube-api-access-hfj5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:14.851952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851922    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnz8f\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-kube-api-access-gnz8f\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.851952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851950    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.851952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851960    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.851952 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851968    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851978    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851987    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfj5z\" (UniqueName: \"kubernetes.io/projected/5bed789a-d64d-4811-b031-d7e9647dc93d-kube-api-access-hfj5z\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.851995    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.852005    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70bb2791-9cc4-4ad5-8116-76bac4ad8b02-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.852015    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.852215 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.852023    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bed789a-d64d-4811-b031-d7e9647dc93d-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:14.929170 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.929134    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:59:14.933459 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.933438    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r5bnn"]
Oct 30 20:59:14.947037 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.947012    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:59:14.949932 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:14.949914    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-bbnk8"]
Oct 30 20:59:15.618447 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:15.618420    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"
Oct 30 20:59:15.646029 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:15.646005    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:59:15.658458 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:15.658431    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-14cca2-openshift-default-d7f87db59-r4g5v"]
Oct 30 20:59:16.370072 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:16.370041    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" path="/var/lib/kubelet/pods/5bed789a-d64d-4811-b031-d7e9647dc93d/volumes"
Oct 30 20:59:16.370638 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:16.370618    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" path="/var/lib/kubelet/pods/70bb2791-9cc4-4ad5-8116-76bac4ad8b02/volumes"
Oct 30 20:59:16.371118 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:16.371103    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" path="/var/lib/kubelet/pods/df86b921-4cd5-4d32-8de0-b7eedfde295b/volumes"
Oct 30 20:59:36.281303 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:36.281262    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 20:59:51.729023 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.728987    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 20:59:51.729593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729558    5115 cpu_manager.go:414] "containerMap: removing container" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy"
Oct 30 20:59:51.729593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729573    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy"
Oct 30 20:59:51.729593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729584    5115 cpu_manager.go:414] "containerMap: removing container" podUID="f207df28-a990-463e-861e-dc92b44c02a5" containerName="payload-pre-processing"
Oct 30 20:59:51.729593 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729590    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f207df28-a990-463e-861e-dc92b44c02a5" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729601    5115 cpu_manager.go:414] "containerMap: removing container" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729606    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729613    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729617    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729628    5115 cpu_manager.go:414] "containerMap: removing container" podUID="a08d3843-5750-4675-aa3d-0a4a673fe053" containerName="maas-api"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729633    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a08d3843-5750-4675-aa3d-0a4a673fe053" containerName="maas-api"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729644    5115 cpu_manager.go:414] "containerMap: removing container" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729649    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729658    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729662    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729672    5115 cpu_manager.go:414] "containerMap: removing container" podUID="75fa66a8-d9d0-4414-ab12-3122e6264dce" containerName="maas-api"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729677    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75fa66a8-d9d0-4414-ab12-3122e6264dce" containerName="maas-api"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729686    5115 cpu_manager.go:414] "containerMap: removing container" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729691    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729697    5115 cpu_manager.go:414] "containerMap: removing container" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729702    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729708    5115 cpu_manager.go:414] "containerMap: removing container" podUID="f3c37318-59d8-41f0-ad68-14f3dea42f87" containerName="payload-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729712    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3c37318-59d8-41f0-ad68-14f3dea42f87" containerName="payload-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729724    5115 cpu_manager.go:414] "containerMap: removing container" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729728    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729734    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729738    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729743    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729747    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729755    5115 cpu_manager.go:414] "containerMap: removing container" podUID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729760    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" containerName="payload-pre-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729768    5115 cpu_manager.go:414] "containerMap: removing container" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing"
Oct 30 20:59:51.729762 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729773    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729780    5115 cpu_manager.go:414] "containerMap: removing container" podUID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729785    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729795    5115 cpu_manager.go:414] "containerMap: removing container" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729799    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729806    5115 cpu_manager.go:414] "containerMap: removing container" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729810    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729822    5115 cpu_manager.go:414] "containerMap: removing container" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729826    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729835    5115 cpu_manager.go:414] "containerMap: removing container" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729840    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729846    5115 cpu_manager.go:414] "containerMap: removing container" podUID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729850    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729856    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729861    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729869    5115 cpu_manager.go:414] "containerMap: removing container" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729873    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729882    5115 cpu_manager.go:414] "containerMap: removing container" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729886    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729895    5115 cpu_manager.go:414] "containerMap: removing container" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729899    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729906    5115 cpu_manager.go:414] "containerMap: removing container" podUID="36d92a51-020a-48c1-85be-ef8b06d9ad36" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729911    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d92a51-020a-48c1-85be-ef8b06d9ad36" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729918    5115 cpu_manager.go:414] "containerMap: removing container" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729922    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729928    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729933    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729941    5115 cpu_manager.go:414] "containerMap: removing container" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.729945    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730023    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="517afcf9-cb2c-44d1-b56e-55256dd24ee4" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730032    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="716d5e83-5a2d-407c-bdca-2bce1950de32" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730040    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="90b0fbc0-47f7-4645-96e9-8705b279e7eb" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730047    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f3a82a7-d1c7-40e1-8978-fd81253fc35e" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730053    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="c45800fe-d3ee-4d5a-b416-3b689e6cc8f4" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730064    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="093c40d9-68c1-4f4f-b787-542ceba1a0e4" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730070    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="651a897a-5eea-4634-9154-daf3587636ef" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730076    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8ac0f5a-29cd-49b2-8a4b-1e8c37cb99d0" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730082    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddc5d32c-308c-4205-8d75-8d25907a52c4" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730087    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="3675e23a-9de5-4cf9-9d50-bccd61cf0f9c" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730093    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="df86b921-4cd5-4d32-8de0-b7eedfde295b" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730097    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="4de48d20-0a7b-46b9-ba54-2f0563a6b5ad" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730103    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="36d92a51-020a-48c1-85be-ef8b06d9ad36" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730109    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bf92ecc-3fef-4d23-9950-f7bb882f633a" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730113    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c6b4bf7-b270-4962-99d8-1ba5fd227745" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730119    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bed789a-d64d-4811-b031-d7e9647dc93d" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730125    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="03d1f441-e639-4ae2-85f8-f4556b916c4d" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730130    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="f207df28-a990-463e-861e-dc92b44c02a5" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730135    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="70bb2791-9cc4-4ad5-8116-76bac4ad8b02" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730141    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1402c404-8b23-4998-afd9-51147b1116ba" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730146    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="a08d3843-5750-4675-aa3d-0a4a673fe053" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730152    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="466a6754-77ac-4419-aca9-6e9f556c0d8a" containerName="main"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730157    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba2ce495-e87a-4832-b25b-e6839444a1d6" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730162    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="75fa66a8-d9d0-4414-ab12-3122e6264dce" containerName="maas-api"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730168    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6d227f8-3db0-4563-bdaa-9a400c817748" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730172    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="7caade46-7205-4e71-976e-444d0d394630" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730177    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3c37318-59d8-41f0-ad68-14f3dea42f87" containerName="payload-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730183    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b3a281-eea1-4a2f-9fd8-a265d53c6ffb" containerName="istio-proxy"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730188    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="2019cffa-9c92-4693-8a2e-377519a1aca0" containerName="payload-pre-processing"
Oct 30 20:59:51.730564 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.730194    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1668fb16-2f70-40d5-be0d-dc505a50c774" containerName="istio-proxy"
Oct 30 20:59:51.733826 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.733806    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.746474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.745912    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-812bfe65\""
Oct 30 20:59:51.746474 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.746023    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-812bfe65-dockercfg-njjfg\""
Oct 30 20:59:51.749451 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.747996    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 20:59:51.754282 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.754250    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dftjm\" (UniqueName: \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.754647 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.754618    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.799487 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.799456    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 20:59:51.803609 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.803590    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.814967 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.814946    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 20:59:51.858630 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.858593    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.858867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.858673    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9v8x\" (UniqueName: \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.858867 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.858796    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dftjm\" (UniqueName: \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.859018 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.858888    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.860444 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.859907    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.893085 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.893052    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dftjm\" (UniqueName: \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\") pod \"payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:51.960214 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.960170    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.960425 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.960312    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9v8x\" (UniqueName: \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.961332 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.961300    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:51.994493 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:51.994407    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9v8x\" (UniqueName: \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\") pod \"payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") " pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:52.063489 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.063454    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:52.077756 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.077720    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 20:59:52.084605 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.084582    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 20:59:52.084730 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.084697    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.087709 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.087689    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-812bfe65-serving-cert\""
Oct 30 20:59:52.124273 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.124053    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:52.279668 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.279634    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.279828 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.279700    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.279985 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.279910    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbtg\" (UniqueName: \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.280097 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.280070    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.381038 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.381006    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbtg\" (UniqueName: \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.381201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.381047    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.381201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.381088    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.381201 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.381113    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.381760 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.381731    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.383681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.383655    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.383681 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.383672    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.392317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.392285    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbtg\" (UniqueName: \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\") pod \"maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.395650 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.395628    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 20:59:52.396872 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:59:52.396853    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1ff3ef_247b_40b0_b4cf_64106dadb1bf.slice/crio-0bcb5e99c32b38f2d0ff62f7851a6a84981742339c73bbeede56efa14520768d WatchSource:0}: Error finding container 0bcb5e99c32b38f2d0ff62f7851a6a84981742339c73bbeede56efa14520768d: Status 404 returned error can't find the container with id 0bcb5e99c32b38f2d0ff62f7851a6a84981742339c73bbeede56efa14520768d
Oct 30 20:59:52.465090 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.465067    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 20:59:52.466487 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:59:52.466462    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bc25e6_edf8_4933_86e2_7c9959b3ebea.slice/crio-57b2b0ce80c71f20b754add3878ceb412add4c667fe8c34bf26f3cdc0fa30c2f WatchSource:0}: Error finding container 57b2b0ce80c71f20b754add3878ceb412add4c667fe8c34bf26f3cdc0fa30c2f: Status 404 returned error can't find the container with id 57b2b0ce80c71f20b754add3878ceb412add4c667fe8c34bf26f3cdc0fa30c2f
Oct 30 20:59:52.487073 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.487047    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:52.803317 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.803290    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 20:59:52.804430 ip-10-0-135-104 kubenswrapper[5115]: W1030 20:59:52.804400    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ffc3f6_7f73_40da_a3e6_d68d72db9774.slice/crio-2f529451282fdc19e77ac3a53e651f7447453f1d30638bc576ef867f67c7bc5b WatchSource:0}: Error finding container 2f529451282fdc19e77ac3a53e651f7447453f1d30638bc576ef867f67c7bc5b: Status 404 returned error can't find the container with id 2f529451282fdc19e77ac3a53e651f7447453f1d30638bc576ef867f67c7bc5b
Oct 30 20:59:52.930071 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.930036    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" event={"ID":"f4bc25e6-edf8-4933-86e2-7c9959b3ebea","Type":"ContainerStarted","Data":"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"}
Oct 30 20:59:52.930244 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.930094    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" event={"ID":"f4bc25e6-edf8-4933-86e2-7c9959b3ebea","Type":"ContainerStarted","Data":"57b2b0ce80c71f20b754add3878ceb412add4c667fe8c34bf26f3cdc0fa30c2f"}
Oct 30 20:59:52.930244 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.930122    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 20:59:52.931388 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.931362    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" event={"ID":"14ffc3f6-7f73-40da-a3e6-d68d72db9774","Type":"ContainerStarted","Data":"2f529451282fdc19e77ac3a53e651f7447453f1d30638bc576ef867f67c7bc5b"}
Oct 30 20:59:52.933047 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.933027    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" event={"ID":"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf","Type":"ContainerStarted","Data":"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"}
Oct 30 20:59:52.933168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.933069    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" event={"ID":"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf","Type":"ContainerStarted","Data":"0bcb5e99c32b38f2d0ff62f7851a6a84981742339c73bbeede56efa14520768d"}
Oct 30 20:59:52.933168 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.933108    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 20:59:52.950704 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.950666    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" podStartSLOduration=1.9506551220000001 podStartE2EDuration="1.950655122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:52.94678452 +0000 UTC m=+1254.750679294" watchObservedRunningTime="2026-10-30 20:59:52.950655122 +0000 UTC m=+1254.754549905"
Oct 30 20:59:52.967822 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:52.967776    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" podStartSLOduration=1.967764516 podStartE2EDuration="1.967764516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:52.963865074 +0000 UTC m=+1254.767759829" watchObservedRunningTime="2026-10-30 20:59:52.967764516 +0000 UTC m=+1254.771659272"
Oct 30 20:59:53.943909 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:53.943868    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" event={"ID":"14ffc3f6-7f73-40da-a3e6-d68d72db9774","Type":"ContainerStarted","Data":"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"}
Oct 30 20:59:53.964246 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:53.964182    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" podStartSLOduration=2.521170657 podStartE2EDuration="2.964164307s" totalImagesPullingTime="442.99365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:53.963162869 +0000 UTC m=+1255.767057625" watchObservedRunningTime="2026-10-30 20:59:53.964164307 +0000 UTC m=+1255.768059063"
Oct 30 20:59:54.952233 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:54.952197    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 20:59:58.295723 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.295681    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 20:59:58.296220 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.295943    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" podUID="5b39ef8e-59aa-44e1-9268-f035458aaf62" containerName="maas-api" containerID="cri-o://bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea" gracePeriod=30
Oct 30 20:59:58.692836 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.692804    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:59:58.777141 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.777107    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\" (UniqueName: \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\") pod \"5b39ef8e-59aa-44e1-9268-f035458aaf62\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") "
Oct 30 20:59:58.777330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.777231    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\") pod \"5b39ef8e-59aa-44e1-9268-f035458aaf62\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") "
Oct 30 20:59:58.777330 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.777269    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") pod \"5b39ef8e-59aa-44e1-9268-f035458aaf62\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") "
Oct 30 20:59:58.777548 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.777435    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\") pod \"5b39ef8e-59aa-44e1-9268-f035458aaf62\" (UID: \"5b39ef8e-59aa-44e1-9268-f035458aaf62\") "
Oct 30 20:59:58.778065 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.778039    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca" pod "5b39ef8e-59aa-44e1-9268-f035458aaf62" (UID: "5b39ef8e-59aa-44e1-9268-f035458aaf62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:58.780028 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.779979    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls" pod "5b39ef8e-59aa-44e1-9268-f035458aaf62" (UID: "5b39ef8e-59aa-44e1-9268-f035458aaf62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:58.782573 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.780735    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb" pod "5b39ef8e-59aa-44e1-9268-f035458aaf62" (UID: "5b39ef8e-59aa-44e1-9268-f035458aaf62"). InnerVolumeSpecName "kube-api-access-586nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:58.796949 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.796910    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs" pod "5b39ef8e-59aa-44e1-9268-f035458aaf62" (UID: "5b39ef8e-59aa-44e1-9268-f035458aaf62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:58.880088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.879991    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b39ef8e-59aa-44e1-9268-f035458aaf62-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:58.880088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.880032    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:58.880088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.880047    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b39ef8e-59aa-44e1-9268-f035458aaf62-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:58.880088 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.880062    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-586nb\" (UniqueName: \"kubernetes.io/projected/5b39ef8e-59aa-44e1-9268-f035458aaf62-kube-api-access-586nb\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:58.993856 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.993824    5115 generic.go:356] "Generic (PLEG): container finished" podID="5b39ef8e-59aa-44e1-9268-f035458aaf62" containerID="bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea" exitCode=0
Oct 30 20:59:58.994017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.993891    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"
Oct 30 20:59:58.994017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.993905    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" event={"ID":"5b39ef8e-59aa-44e1-9268-f035458aaf62","Type":"ContainerDied","Data":"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"}
Oct 30 20:59:58.994017 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.993996    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx" event={"ID":"5b39ef8e-59aa-44e1-9268-f035458aaf62","Type":"ContainerDied","Data":"9bff54cf12023e96067b12fcf30fb1075414a6da5c9a1380baf803db8a1a8939"}
Oct 30 20:59:58.994117 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:58.994025    5115 scope.go:122] "RemoveContainer" containerID="bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"
Oct 30 20:59:59.005973 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:59.005948    5115 scope.go:122] "RemoveContainer" containerID="bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"
Oct 30 20:59:59.006270 ip-10-0-135-104 kubenswrapper[5115]: E1030 20:59:59.006249    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea\": container with ID starting with bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea not found: ID does not exist" containerID="bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"
Oct 30 20:59:59.006367 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:59.006282    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea"} err="failed to get container status \"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea\": rpc error: code = NotFound desc = could not find container \"bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea\": container with ID starting with bd3ca39cd7f4bfebcc7a415f504fd2485697a406713084dd470d7fe918f9e9ea not found: ID does not exist"
Oct 30 20:59:59.017795 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:59.017772    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 20:59:59.021563 ip-10-0-135-104 kubenswrapper[5115]: I1030 20:59:59.021535    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-3d909d-69555d4fcb-s2crx"]
Oct 30 21:00:00.369276 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:00.369240    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b39ef8e-59aa-44e1-9268-f035458aaf62" path="/var/lib/kubelet/pods/5b39ef8e-59aa-44e1-9268-f035458aaf62/volumes"
Oct 30 21:00:00.964004 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:00.963978    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 21:00:03.947157 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:03.947129    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 21:00:03.947624 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:03.947196    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 21:00:06.285972 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:06.285928    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:00:06.332177 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.332138    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 21:00:06.332396 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.332371    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy" containerID="cri-o://5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea" gracePeriod=30
Oct 30 21:00:06.349535 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.349484    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 21:00:06.349783 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.349737    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" containerID="cri-o://6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4" gracePeriod=30
Oct 30 21:00:06.373095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.373066    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 21:00:06.373270 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:06.373251    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy" containerID="cri-o://81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f" gracePeriod=30
Oct 30 21:00:10.876266 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:10.876227    5115 patch_prober.go:29] interesting pod/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:00:10.876787 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:10.876295    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:00:11.688817 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.688215    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 21:00:11.763702 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.763666    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 21:00:11.769079 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.769040    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 21:00:11.780010 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.779977    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.780600 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780564    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780739 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780631    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780739 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780661    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.780739 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780697    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780739 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780727    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780778    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780812    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780856    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780885    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780928    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.780964 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.780958    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781018    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781052    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781097    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781131    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781170    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.781275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781204    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.781728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781287    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.781728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781313    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.781728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781344    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\") pod \"11dc7685-6491-4e40-88b6-a8b1e1886382\" (UID: \"11dc7685-6491-4e40-88b6-a8b1e1886382\") "
Oct 30 21:00:11.781728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781372    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.781728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.781401    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.782690    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.782926    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.782939    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.782944    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.782969    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783006    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\") pod \"5ebdfff8-d160-4f26-b62c-0de75c84673b\" (UID: \"5ebdfff8-d160-4f26-b62c-0de75c84673b\") "
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783053    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783058    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\") pod \"3e747449-02be-4dff-9486-665f5bc54c6d\" (UID: \"3e747449-02be-4dff-9486-665f5bc54c6d\") "
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783106    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.783446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783313    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783562    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783736    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783759    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783773    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783789    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ebdfff8-d160-4f26-b62c-0de75c84673b-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783803    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783817    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.783831    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.784113 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.784066    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.784966 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.784921    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:11.786583 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.785446    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:11.786583 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.785715    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.786583 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.785971    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.786583 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.786325    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.786890 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.786616    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.786890 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.786759    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.793416 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.793356    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.793973 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.793916    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.794094 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794070    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.794350 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794315    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.794350 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794339    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "kube-api-access-75vxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.794552 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794429    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:00:11.794775 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794731    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4" pod "3e747449-02be-4dff-9486-665f5bc54c6d" (UID: "3e747449-02be-4dff-9486-665f5bc54c6d"). InnerVolumeSpecName "kube-api-access-77fg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.795066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.794838    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "kube-api-access-zbcbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.795707 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.795681    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:11.795854 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.795816    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo" pod "5ebdfff8-d160-4f26-b62c-0de75c84673b" (UID: "5ebdfff8-d160-4f26-b62c-0de75c84673b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:00:11.798187 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.798157    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:00:11.798923 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.798895    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy" pod "11dc7685-6491-4e40-88b6-a8b1e1886382" (UID: "11dc7685-6491-4e40-88b6-a8b1e1886382"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884855    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884880    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884889    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884897    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884906    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884915    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884923    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11dc7685-6491-4e40-88b6-a8b1e1886382-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884932    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11dc7685-6491-4e40-88b6-a8b1e1886382-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.884941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884940    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884949    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77fg4\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-kube-api-access-77fg4\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884959    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884968    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75vxk\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-kube-api-access-75vxk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884977    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884986    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbcbx\" (UniqueName: \"kubernetes.io/projected/11dc7685-6491-4e40-88b6-a8b1e1886382-kube-api-access-zbcbx\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.884994    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e747449-02be-4dff-9486-665f5bc54c6d-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.885003    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ebdfff8-d160-4f26-b62c-0de75c84673b-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.885014    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e747449-02be-4dff-9486-665f5bc54c6d-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.885024    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ebdfff8-d160-4f26-b62c-0de75c84673b-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.885032    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e747449-02be-4dff-9486-665f5bc54c6d-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:11.885838 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:11.885040    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e747449-02be-4dff-9486-665f5bc54c6d-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:12.088425 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.088386    5115 generic.go:356] "Generic (PLEG): container finished" podID="3e747449-02be-4dff-9486-665f5bc54c6d" containerID="6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4" exitCode=0
Oct 30 21:00:12.088649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.088443    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" event={"ID":"3e747449-02be-4dff-9486-665f5bc54c6d","Type":"ContainerDied","Data":"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"}
Oct 30 21:00:12.088649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.088453    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"
Oct 30 21:00:12.088649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.088499    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf" event={"ID":"3e747449-02be-4dff-9486-665f5bc54c6d","Type":"ContainerDied","Data":"eb90835fc49265db8e94459dc444de3154cdf12ac32d0c2dcdc880d69304461d"}
Oct 30 21:00:12.088649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.088562    5115 scope.go:122] "RemoveContainer" containerID="6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"
Oct 30 21:00:12.090293 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.090269    5115 generic.go:356] "Generic (PLEG): container finished" podID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerID="5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea" exitCode=0
Oct 30 21:00:12.090406 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.090370    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"
Oct 30 21:00:12.090580 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.090513    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" event={"ID":"5ebdfff8-d160-4f26-b62c-0de75c84673b","Type":"ContainerDied","Data":"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"}
Oct 30 21:00:12.090668 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.090607    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5" event={"ID":"5ebdfff8-d160-4f26-b62c-0de75c84673b","Type":"ContainerDied","Data":"232abaaeeda03abd539c6fd3335346b7079da8577ae0072bdbcce13e60730909"}
Oct 30 21:00:12.092265 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.092241    5115 generic.go:356] "Generic (PLEG): container finished" podID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerID="81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f" exitCode=0
Oct 30 21:00:12.092388 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.092282    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"
Oct 30 21:00:12.092388 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.092285    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" event={"ID":"11dc7685-6491-4e40-88b6-a8b1e1886382","Type":"ContainerDied","Data":"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"}
Oct 30 21:00:12.092388 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.092321    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp" event={"ID":"11dc7685-6491-4e40-88b6-a8b1e1886382","Type":"ContainerDied","Data":"25ea8b262f7724a05cfb86b87a38cf10fc643ef2488e855a8cd05fd4db21e171"}
Oct 30 21:00:12.100807 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.100781    5115 scope.go:122] "RemoveContainer" containerID="6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"
Oct 30 21:00:12.101109 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:12.101090    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4\": container with ID starting with 6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4 not found: ID does not exist" containerID="6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"
Oct 30 21:00:12.101205 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.101115    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4"} err="failed to get container status \"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4\": rpc error: code = NotFound desc = could not find container \"6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4\": container with ID starting with 6dd9d9e3a7cb81cf5d2a763df8d23fc70b754b476b1f24b4cf3958b6bb7016b4 not found: ID does not exist"
Oct 30 21:00:12.101205 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.101131    5115 scope.go:122] "RemoveContainer" containerID="5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"
Oct 30 21:00:12.110989 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.110965    5115 scope.go:122] "RemoveContainer" containerID="5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"
Oct 30 21:00:12.111261 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:12.111243    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea\": container with ID starting with 5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea not found: ID does not exist" containerID="5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"
Oct 30 21:00:12.111333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.111268    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea"} err="failed to get container status \"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea\": rpc error: code = NotFound desc = could not find container \"5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea\": container with ID starting with 5e73009196e764e6a69d1f82d0b38c8c3d35dcf8165b5e91632f97e081f276ea not found: ID does not exist"
Oct 30 21:00:12.111333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.111282    5115 scope.go:122] "RemoveContainer" containerID="81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"
Oct 30 21:00:12.121475 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.121452    5115 scope.go:122] "RemoveContainer" containerID="81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"
Oct 30 21:00:12.121732 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.121711    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 21:00:12.121825 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:12.121803    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f\": container with ID starting with 81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f not found: ID does not exist" containerID="81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"
Oct 30 21:00:12.121886 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.121830    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f"} err="failed to get container status \"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f\": rpc error: code = NotFound desc = could not find container \"81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f\": container with ID starting with 81a1c6095baa4c644aad5d29466d25050d79cb106763f1470881bd6a66a3f25f not found: ID does not exist"
Oct 30 21:00:12.125099 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.125076    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-zw6wf"]
Oct 30 21:00:12.145400 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.145345    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 21:00:12.149375 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.149349    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-x7mz5"]
Oct 30 21:00:12.160335 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.160312    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 21:00:12.166204 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.166183    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-3d909d-openshift-default-77787695b7-mnbfp"]
Oct 30 21:00:12.371563 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.371507    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" path="/var/lib/kubelet/pods/11dc7685-6491-4e40-88b6-a8b1e1886382/volumes"
Oct 30 21:00:12.372403 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.372376    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" path="/var/lib/kubelet/pods/3e747449-02be-4dff-9486-665f5bc54c6d/volumes"
Oct 30 21:00:12.373145 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:12.373122    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" path="/var/lib/kubelet/pods/5ebdfff8-d160-4f26-b62c-0de75c84673b/volumes"
Oct 30 21:00:32.779217 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:32.779178    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 21:00:32.792030 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:32.791999    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 21:00:36.280578 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:36.280509    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:00:37.780082 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:37.780037    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing" containerID="cri-o://1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f" gracePeriod=25
Oct 30 21:00:37.792825 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:37.792778    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing" containerID="cri-o://0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371" gracePeriod=25
Oct 30 21:00:45.150607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:45.150488    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:00:46.158224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:46.158181    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:00:48.116086 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.116047    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 21:00:48.116641 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.116349    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" podUID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" containerName="maas-api" containerID="cri-o://d02d63fbe4a8fa3946979e36bd877cda86cece7d7119281af843328a3ace2508" gracePeriod=30
Oct 30 21:00:48.376200 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.376109    5115 generic.go:356] "Generic (PLEG): container finished" podID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" containerID="d02d63fbe4a8fa3946979e36bd877cda86cece7d7119281af843328a3ace2508" exitCode=0
Oct 30 21:00:48.382246 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.382209    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" event={"ID":"279b438d-f6b0-4b2a-8ac8-d0fe1490c313","Type":"ContainerDied","Data":"d02d63fbe4a8fa3946979e36bd877cda86cece7d7119281af843328a3ace2508"}
Oct 30 21:00:48.407000 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.406975    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 21:00:48.457875 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.457846    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\" (UniqueName: \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\") pod \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") "
Oct 30 21:00:48.458072 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.457899    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\") pod \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") "
Oct 30 21:00:48.458072 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.457976    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\") pod \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") "
Oct 30 21:00:48.458072 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.458012    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\") pod \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\" (UID: \"279b438d-f6b0-4b2a-8ac8-d0fe1490c313\") "
Oct 30 21:00:48.458707 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.458676    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca" pod "279b438d-f6b0-4b2a-8ac8-d0fe1490c313" (UID: "279b438d-f6b0-4b2a-8ac8-d0fe1490c313"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:48.465575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.460711    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls" pod "279b438d-f6b0-4b2a-8ac8-d0fe1490c313" (UID: "279b438d-f6b0-4b2a-8ac8-d0fe1490c313"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:48.465575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.460978    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs" pod "279b438d-f6b0-4b2a-8ac8-d0fe1490c313" (UID: "279b438d-f6b0-4b2a-8ac8-d0fe1490c313"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:48.465887 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.465854    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc" pod "279b438d-f6b0-4b2a-8ac8-d0fe1490c313" (UID: "279b438d-f6b0-4b2a-8ac8-d0fe1490c313"). InnerVolumeSpecName "kube-api-access-hsdrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:48.559249 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.559208    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:48.559249 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.559243    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:48.559249 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.559254    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:48.559484 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:48.559264    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsdrc\" (UniqueName: \"kubernetes.io/projected/279b438d-f6b0-4b2a-8ac8-d0fe1490c313-kube-api-access-hsdrc\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:49.400590 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:49.400552    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2" event={"ID":"279b438d-f6b0-4b2a-8ac8-d0fe1490c313","Type":"ContainerDied","Data":"173067bfb716908a308088e3f8f3f451137813fd922f57cc15c6d472b8575017"}
Oct 30 21:00:49.401200 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:49.401178    5115 scope.go:122] "RemoveContainer" containerID="d02d63fbe4a8fa3946979e36bd877cda86cece7d7119281af843328a3ace2508"
Oct 30 21:00:49.401460 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:49.401441    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"
Oct 30 21:00:49.452609 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:49.452573    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 21:00:49.467867 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:49.467829    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b8aee1-6c7cdfb8b-k68j2"]
Oct 30 21:00:50.370123 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:50.370091    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" path="/var/lib/kubelet/pods/279b438d-f6b0-4b2a-8ac8-d0fe1490c313/volumes"
Oct 30 21:00:55.149870 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:55.149828    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:00:56.158202 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:56.158159    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:00:57.263028 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.262989    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 21:00:57.263575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.263309    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy" containerID="cri-o://667b54a403e9596fadcf81b8effe868f754be4ac39c94302e8a522ed0a49815c" gracePeriod=30
Oct 30 21:00:57.272651 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.272606    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 21:00:57.272881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.272859    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy" containerID="cri-o://2ee05cb28044d5f474f8af909c113126edea7d3ec43de38238d8f98d84bcc51e" gracePeriod=30
Oct 30 21:00:57.295459 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.295420    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 21:00:57.295707 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:57.295683    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" containerID="cri-o://75c0709761b87c3a43de27deeddf0c2a84d8993ed20ddc85d0422cb595ab046e" gracePeriod=30
Oct 30 21:00:58.067872 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.067845    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 21:00:58.129430 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.129396    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 21:00:58.212360 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212321    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\" (UniqueName: \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\") pod \"873c7a86-ec41-43d3-b2db-8789ca4de288\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") "
Oct 30 21:00:58.212575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212426    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\") pod \"03826521-fb34-4e9b-ab13-bde04b1beb29\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") "
Oct 30 21:00:58.212575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212449    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\" (UniqueName: \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\") pod \"03826521-fb34-4e9b-ab13-bde04b1beb29\" (UID: \"03826521-fb34-4e9b-ab13-bde04b1beb29\") "
Oct 30 21:00:58.212575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212478    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\") pod \"873c7a86-ec41-43d3-b2db-8789ca4de288\" (UID: \"873c7a86-ec41-43d3-b2db-8789ca4de288\") "
Oct 30 21:00:58.212931 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212903    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume" pod "873c7a86-ec41-43d3-b2db-8789ca4de288" (UID: "873c7a86-ec41-43d3-b2db-8789ca4de288"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:58.213017 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.212927    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume" pod "03826521-fb34-4e9b-ab13-bde04b1beb29" (UID: "03826521-fb34-4e9b-ab13-bde04b1beb29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:58.214773 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.214750    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg" pod "03826521-fb34-4e9b-ab13-bde04b1beb29" (UID: "03826521-fb34-4e9b-ab13-bde04b1beb29"). InnerVolumeSpecName "kube-api-access-rwkjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:58.214860 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.214800    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt" pod "873c7a86-ec41-43d3-b2db-8789ca4de288" (UID: "873c7a86-ec41-43d3-b2db-8789ca4de288"). InnerVolumeSpecName "kube-api-access-h95vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:58.314098 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.314001    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03826521-fb34-4e9b-ab13-bde04b1beb29-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:58.314098 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.314033    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwkjg\" (UniqueName: \"kubernetes.io/projected/03826521-fb34-4e9b-ab13-bde04b1beb29-kube-api-access-rwkjg\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:58.314098 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.314043    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/873c7a86-ec41-43d3-b2db-8789ca4de288-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:58.314098 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.314052    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h95vt\" (UniqueName: \"kubernetes.io/projected/873c7a86-ec41-43d3-b2db-8789ca4de288-kube-api-access-h95vt\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:58.463710 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.462984    5115 generic.go:356] "Generic (PLEG): container finished" podID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerID="1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f" exitCode=0
Oct 30 21:00:58.463710 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.463100    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"
Oct 30 21:00:58.463710 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.463171    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" event={"ID":"03826521-fb34-4e9b-ab13-bde04b1beb29","Type":"ContainerDied","Data":"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"}
Oct 30 21:00:58.463710 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.463215    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr" event={"ID":"03826521-fb34-4e9b-ab13-bde04b1beb29","Type":"ContainerDied","Data":"0898b8e226117d25525e8656d71ddfe1255cdbd911f29b5f2599fdc29fc7c77d"}
Oct 30 21:00:58.463710 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.463273    5115 scope.go:122] "RemoveContainer" containerID="1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"
Oct 30 21:00:58.465829 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.465442    5115 generic.go:356] "Generic (PLEG): container finished" podID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerID="0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371" exitCode=0
Oct 30 21:00:58.465829 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.465482    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" event={"ID":"873c7a86-ec41-43d3-b2db-8789ca4de288","Type":"ContainerDied","Data":"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"}
Oct 30 21:00:58.465829 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.465589    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn" event={"ID":"873c7a86-ec41-43d3-b2db-8789ca4de288","Type":"ContainerDied","Data":"d377f8d954fa54e568b4c764d306af4e4bbc1a867af25879d2710d5f5c43fa6e"}
Oct 30 21:00:58.465829 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.465493    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"
Oct 30 21:00:58.475037 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.475013    5115 scope.go:122] "RemoveContainer" containerID="1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"
Oct 30 21:00:58.475361 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:58.475339    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f\": container with ID starting with 1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f not found: ID does not exist" containerID="1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"
Oct 30 21:00:58.475438 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.475377    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f"} err="failed to get container status \"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f\": rpc error: code = NotFound desc = could not find container \"1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f\": container with ID starting with 1b4e47e4689772ae17c4772941ecc1a89afc529b5225b4046006d416780d666f not found: ID does not exist"
Oct 30 21:00:58.475438 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.475394    5115 scope.go:122] "RemoveContainer" containerID="0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"
Oct 30 21:00:58.483265 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.483240    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 21:00:58.485028 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.485012    5115 scope.go:122] "RemoveContainer" containerID="0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"
Oct 30 21:00:58.485326 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:00:58.485300    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371\": container with ID starting with 0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371 not found: ID does not exist" containerID="0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"
Oct 30 21:00:58.485423 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.485332    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371"} err="failed to get container status \"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371\": rpc error: code = NotFound desc = could not find container \"0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371\": container with ID starting with 0a7306be09d50c38d28851a254923ef4d76c93c014dba23ebdda4a1b215e1371 not found: ID does not exist"
Oct 30 21:00:58.496551 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.496403    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b8aee1-67bbf75456-rb4jr"]
Oct 30 21:00:58.503843 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.503802    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 21:00:58.507644 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:00:58.507617    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b8aee1-6bdd6fc6b7-95jmn"]
Oct 30 21:01:00.266849 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:00.266806    5115 patch_prober.go:29] interesting pod/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:01:00.267225 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:00.266862    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:01:00.369188 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:00.369155    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" path="/var/lib/kubelet/pods/03826521-fb34-4e9b-ab13-bde04b1beb29/volumes"
Oct 30 21:01:00.369686 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:00.369670    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" path="/var/lib/kubelet/pods/873c7a86-ec41-43d3-b2db-8789ca4de288/volumes"
Oct 30 21:01:02.498660 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.497279    5115 generic.go:356] "Generic (PLEG): container finished" podID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerID="2ee05cb28044d5f474f8af909c113126edea7d3ec43de38238d8f98d84bcc51e" exitCode=0
Oct 30 21:01:02.498660 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.497388    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" event={"ID":"74a7f94d-774e-4d1f-b51b-edee859f2919","Type":"ContainerDied","Data":"2ee05cb28044d5f474f8af909c113126edea7d3ec43de38238d8f98d84bcc51e"}
Oct 30 21:01:02.499201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.499182    5115 generic.go:356] "Generic (PLEG): container finished" podID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerID="75c0709761b87c3a43de27deeddf0c2a84d8993ed20ddc85d0422cb595ab046e" exitCode=0
Oct 30 21:01:02.499290 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.499263    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" event={"ID":"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4","Type":"ContainerDied","Data":"75c0709761b87c3a43de27deeddf0c2a84d8993ed20ddc85d0422cb595ab046e"}
Oct 30 21:01:02.501001 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.500886    5115 generic.go:356] "Generic (PLEG): container finished" podID="e0d01618-f816-421d-9cbd-7d73db71c606" containerID="667b54a403e9596fadcf81b8effe868f754be4ac39c94302e8a522ed0a49815c" exitCode=0
Oct 30 21:01:02.501001 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.500958    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" event={"ID":"e0d01618-f816-421d-9cbd-7d73db71c606","Type":"ContainerDied","Data":"667b54a403e9596fadcf81b8effe868f754be4ac39c94302e8a522ed0a49815c"}
Oct 30 21:01:02.594791 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.594759    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 21:01:02.674579 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.674549    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 21:01:02.680194 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.680160    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 21:01:02.768447 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768412    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768474    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768503    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768521    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768551    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768571    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768602    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768638    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.768674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768677    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768713    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768759    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768801    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768831    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768876    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768894    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768907    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768927    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.768969    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769045    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.769105 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769049    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769122    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769125    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769205    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769283    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769316    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769346    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\") pod \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\" (UID: \"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769376    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769414    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769442    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769489    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\") pod \"e0d01618-f816-421d-9cbd-7d73db71c606\" (UID: \"e0d01618-f816-421d-9cbd-7d73db71c606\") "
Oct 30 21:01:02.769721 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769562    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\") pod \"74a7f94d-774e-4d1f-b51b-edee859f2919\" (UID: \"74a7f94d-774e-4d1f-b51b-edee859f2919\") "
Oct 30 21:01:02.770300 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770191    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.770300 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770214    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.770300 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770230    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.770300 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770245    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769281    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769619    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.769903    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770180    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.770469    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771143    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771436    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.771470 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771162    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.772044 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771342    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.772044 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771485    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.772044 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771460    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.772044 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.771564    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:02.772516 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.772383    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:01:02.772516 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.772451    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:01:02.772516 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.772467    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.772516 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.772474    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "kube-api-access-75lr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.773033 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.773005    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:01:02.773124 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.773059    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.773203 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.773151    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "kube-api-access-bqwz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.773488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.773469    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "kube-api-access-wtpxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.773872 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.773851    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy" pod "74a7f94d-774e-4d1f-b51b-edee859f2919" (UID: "74a7f94d-774e-4d1f-b51b-edee859f2919"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.774176 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.774155    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy" pod "e0d01618-f816-421d-9cbd-7d73db71c606" (UID: "e0d01618-f816-421d-9cbd-7d73db71c606"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:02.774648 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.774631    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token" pod "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" (UID: "b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871804    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75lr8\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-kube-api-access-75lr8\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871831    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871841    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871850    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871859    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871867    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.871881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871886    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871895    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a7f94d-774e-4d1f-b51b-edee859f2919-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871904    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpxj\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-kube-api-access-wtpxj\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871915    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871923    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d01618-f816-421d-9cbd-7d73db71c606-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871932    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871941    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d01618-f816-421d-9cbd-7d73db71c606-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871949    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871957    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d01618-f816-421d-9cbd-7d73db71c606-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871965    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871972    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871980    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871988    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.871996    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqwz7\" (UniqueName: \"kubernetes.io/projected/74a7f94d-774e-4d1f-b51b-edee859f2919-kube-api-access-bqwz7\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.872004    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a7f94d-774e-4d1f-b51b-edee859f2919-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.872014    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:02.872224 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:02.872022    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d01618-f816-421d-9cbd-7d73db71c606-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:03.510726 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.510696    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"
Oct 30 21:01:03.511396 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.510729    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht" event={"ID":"74a7f94d-774e-4d1f-b51b-edee859f2919","Type":"ContainerDied","Data":"482f3ec5000fab9ec5cf2b2a6f23f727dc9e9864281526bffd51181aab932705"}
Oct 30 21:01:03.511396 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.510827    5115 scope.go:122] "RemoveContainer" containerID="2ee05cb28044d5f474f8af909c113126edea7d3ec43de38238d8f98d84bcc51e"
Oct 30 21:01:03.513004 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.512976    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht" event={"ID":"b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4","Type":"ContainerDied","Data":"fd3eec3725f831c13dff938304001ab52d9c6a5bfabbd0066d0e09516983ce0b"}
Oct 30 21:01:03.513117 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.513098    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"
Oct 30 21:01:03.518366 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.517213    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5" event={"ID":"e0d01618-f816-421d-9cbd-7d73db71c606","Type":"ContainerDied","Data":"ae883c27bcc9ebc6555b92de3cef5b944536b154be804ba4d30bddaa68ccf9be"}
Oct 30 21:01:03.518366 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.517317    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"
Oct 30 21:01:03.532883 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.532858    5115 scope.go:122] "RemoveContainer" containerID="75c0709761b87c3a43de27deeddf0c2a84d8993ed20ddc85d0422cb595ab046e"
Oct 30 21:01:03.543607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.543581    5115 scope.go:122] "RemoveContainer" containerID="667b54a403e9596fadcf81b8effe868f754be4ac39c94302e8a522ed0a49815c"
Oct 30 21:01:03.553339 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.553313    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 21:01:03.557010 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.556988    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-s72ht"]
Oct 30 21:01:03.564859 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.564832    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 21:01:03.571781 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.571762    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-ts2ht"]
Oct 30 21:01:03.580878 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.580858    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 21:01:03.585768 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:03.585748    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b8aee1-openshift-default-775cfffcf9-9vgc5"]
Oct 30 21:01:04.378675 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:04.378638    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" path="/var/lib/kubelet/pods/74a7f94d-774e-4d1f-b51b-edee859f2919/volumes"
Oct 30 21:01:04.379118 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:04.379105    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" path="/var/lib/kubelet/pods/b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4/volumes"
Oct 30 21:01:04.379535 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:04.379507    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" path="/var/lib/kubelet/pods/e0d01618-f816-421d-9cbd-7d73db71c606/volumes"
Oct 30 21:01:06.283835 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:01:06.283799    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:01:36.279760 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:01:36.279723    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:01:47.905348 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:47.905301    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 21:01:47.911315 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:47.911283    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 21:01:48.200440 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.187897    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 21:01:48.201773 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.201726    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" podUID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" containerName="maas-api" containerID="cri-o://705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125" gracePeriod=30
Oct 30 21:01:48.487116 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.487087    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 21:01:48.606118 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606083    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\") pod \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") "
Oct 30 21:01:48.606313 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606295    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\" (UniqueName: \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\") pod \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") "
Oct 30 21:01:48.606397 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606363    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\") pod \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") "
Oct 30 21:01:48.606457 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606398    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\") pod \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\" (UID: \"14ffc3f6-7f73-40da-a3e6-d68d72db9774\") "
Oct 30 21:01:48.606775 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606747    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca" pod "14ffc3f6-7f73-40da-a3e6-d68d72db9774" (UID: "14ffc3f6-7f73-40da-a3e6-d68d72db9774"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:48.606893 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.606842    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ffc3f6-7f73-40da-a3e6-d68d72db9774-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:48.608437 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.608413    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls" pod "14ffc3f6-7f73-40da-a3e6-d68d72db9774" (UID: "14ffc3f6-7f73-40da-a3e6-d68d72db9774"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:48.608594 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.608440    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs" pod "14ffc3f6-7f73-40da-a3e6-d68d72db9774" (UID: "14ffc3f6-7f73-40da-a3e6-d68d72db9774"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:48.608594 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.608507    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg" pod "14ffc3f6-7f73-40da-a3e6-d68d72db9774" (UID: "14ffc3f6-7f73-40da-a3e6-d68d72db9774"). InnerVolumeSpecName "kube-api-access-vvbtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:48.708097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.708059    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:48.708097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.708092    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvbtg\" (UniqueName: \"kubernetes.io/projected/14ffc3f6-7f73-40da-a3e6-d68d72db9774-kube-api-access-vvbtg\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:48.708097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.708105    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ffc3f6-7f73-40da-a3e6-d68d72db9774-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:48.825605 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.823220    5115 generic.go:356] "Generic (PLEG): container finished" podID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" containerID="705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125" exitCode=0
Oct 30 21:01:48.825605 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.823270    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"
Oct 30 21:01:48.825605 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.823261    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" event={"ID":"14ffc3f6-7f73-40da-a3e6-d68d72db9774","Type":"ContainerDied","Data":"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"}
Oct 30 21:01:48.825605 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.823391    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9" event={"ID":"14ffc3f6-7f73-40da-a3e6-d68d72db9774","Type":"ContainerDied","Data":"2f529451282fdc19e77ac3a53e651f7447453f1d30638bc576ef867f67c7bc5b"}
Oct 30 21:01:48.825605 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.823421    5115 scope.go:122] "RemoveContainer" containerID="705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"
Oct 30 21:01:48.836265 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.836241    5115 scope.go:122] "RemoveContainer" containerID="705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"
Oct 30 21:01:48.836665 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:01:48.836639    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125\": container with ID starting with 705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125 not found: ID does not exist" containerID="705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"
Oct 30 21:01:48.836784 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.836676    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125"} err="failed to get container status \"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125\": rpc error: code = NotFound desc = could not find container \"705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125\": container with ID starting with 705351b086d0ed97ca1d036c2907929fb556683dfd70a4bcf4c7af4088aa4125 not found: ID does not exist"
Oct 30 21:01:48.850546 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.850501    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 21:01:48.854593 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:48.854563    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-812bfe65-b9dcc4cbf-ngqr9"]
Oct 30 21:01:50.368926 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:50.368887    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" path="/var/lib/kubelet/pods/14ffc3f6-7f73-40da-a3e6-d68d72db9774/volumes"
Oct 30 21:01:52.906243 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:52.906204    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" podUID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" containerName="payload-processing" containerID="cri-o://476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831" gracePeriod=25
Oct 30 21:01:52.911831 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:52.911799    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" podUID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" containerName="payload-pre-processing" containerID="cri-o://eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c" gracePeriod=25
Oct 30 21:01:53.187647 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.187622    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 21:01:53.215781 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.215756    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 21:01:53.263062 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.262861    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\") pod \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") "
Oct 30 21:01:53.263062 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.263045    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\" (UniqueName: \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\") pod \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\" (UID: \"f4bc25e6-edf8-4933-86e2-7c9959b3ebea\") "
Oct 30 21:01:53.263832 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.263792    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume" pod "f4bc25e6-edf8-4933-86e2-7c9959b3ebea" (UID: "f4bc25e6-edf8-4933-86e2-7c9959b3ebea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:53.265859 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.265815    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x" pod "f4bc25e6-edf8-4933-86e2-7c9959b3ebea" (UID: "f4bc25e6-edf8-4933-86e2-7c9959b3ebea"). InnerVolumeSpecName "kube-api-access-p9v8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:53.364561 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.364496    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\") pod \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") "
Oct 30 21:01:53.364765 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.364667    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\" (UniqueName: \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\") pod \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\" (UID: \"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf\") "
Oct 30 21:01:53.364855 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.364831    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume" pod "2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" (UID: "2b1ff3ef-247b-40b0-b4cf-64106dadb1bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:53.365009 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.364992    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:53.365080 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.365013    5115 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-plugins-config-volume\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:53.365080 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.365029    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9v8x\" (UniqueName: \"kubernetes.io/projected/f4bc25e6-edf8-4933-86e2-7c9959b3ebea-kube-api-access-p9v8x\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:53.366595 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.366574    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm" pod "2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" (UID: "2b1ff3ef-247b-40b0-b4cf-64106dadb1bf"). InnerVolumeSpecName "kube-api-access-dftjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:53.466913 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.466818    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dftjm\" (UniqueName: \"kubernetes.io/projected/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf-kube-api-access-dftjm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:53.868595 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.868559    5115 generic.go:356] "Generic (PLEG): container finished" podID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" containerID="eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c" exitCode=0
Oct 30 21:01:53.868830 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.868618    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"
Oct 30 21:01:53.868830 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.868645    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" event={"ID":"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf","Type":"ContainerDied","Data":"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"}
Oct 30 21:01:53.868830 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.868692    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p" event={"ID":"2b1ff3ef-247b-40b0-b4cf-64106dadb1bf","Type":"ContainerDied","Data":"0bcb5e99c32b38f2d0ff62f7851a6a84981742339c73bbeede56efa14520768d"}
Oct 30 21:01:53.868830 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.868717    5115 scope.go:122] "RemoveContainer" containerID="eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"
Oct 30 21:01:53.870196 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.870170    5115 generic.go:356] "Generic (PLEG): container finished" podID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" containerID="476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831" exitCode=0
Oct 30 21:01:53.870307 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.870215    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"
Oct 30 21:01:53.870307 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.870235    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" event={"ID":"f4bc25e6-edf8-4933-86e2-7c9959b3ebea","Type":"ContainerDied","Data":"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"}
Oct 30 21:01:53.870307 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.870276    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj" event={"ID":"f4bc25e6-edf8-4933-86e2-7c9959b3ebea","Type":"ContainerDied","Data":"57b2b0ce80c71f20b754add3878ceb412add4c667fe8c34bf26f3cdc0fa30c2f"}
Oct 30 21:01:53.881022 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.881006    5115 scope.go:122] "RemoveContainer" containerID="eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"
Oct 30 21:01:53.881328 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:01:53.881307    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c\": container with ID starting with eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c not found: ID does not exist" containerID="eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"
Oct 30 21:01:53.881418 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.881337    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c"} err="failed to get container status \"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c\": rpc error: code = NotFound desc = could not find container \"eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c\": container with ID starting with eb5131349112ece6bc1ed81e502c2e76a35e793acf67534b70d5eb1a9c7a7e7c not found: ID does not exist"
Oct 30 21:01:53.881418 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.881354    5115 scope.go:122] "RemoveContainer" containerID="476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"
Oct 30 21:01:53.890660 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.890638    5115 scope.go:122] "RemoveContainer" containerID="476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"
Oct 30 21:01:53.891041 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:01:53.891014    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831\": container with ID starting with 476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831 not found: ID does not exist" containerID="476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"
Oct 30 21:01:53.891154 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.891049    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831"} err="failed to get container status \"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831\": rpc error: code = NotFound desc = could not find container \"476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831\": container with ID starting with 476ed9d1613591129b5ec04439c8ea78930a69d59cb9dee53bf884c54b610831 not found: ID does not exist"
Oct 30 21:01:53.892152 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.892130    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 21:01:53.895187 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.895163    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-812bfe65-5c4c6ddbc5-v9h9p"]
Oct 30 21:01:53.907560 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.907515    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 21:01:53.910859 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:53.910837    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-812bfe65-7864d857cd-zcgdj"]
Oct 30 21:01:54.374408 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:54.374374    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" path="/var/lib/kubelet/pods/2b1ff3ef-247b-40b0-b4cf-64106dadb1bf/volumes"
Oct 30 21:01:54.374814 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:01:54.374800    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" path="/var/lib/kubelet/pods/f4bc25e6-edf8-4933-86e2-7c9959b3ebea/volumes"
Oct 30 21:02:06.280197 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:02:06.280160    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:02:22.181025 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:22.180985    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 21:02:36.280370 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:02:36.280328    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:02:37.202076 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.202008    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main" containerID="cri-o://712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea" gracePeriod=45
Oct 30 21:02:37.463373 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.463295    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 21:02:37.588900 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.588868    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.588998    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589086    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\" (UniqueName: \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589213 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589135    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589213 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589164    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589213 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589162    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:37.589363 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589259    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\") pod \"1f296a7d-85a6-420f-a88a-8f818293e54d\" (UID: \"1f296a7d-85a6-420f-a88a-8f818293e54d\") "
Oct 30 21:02:37.589363 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589285    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:37.589683 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589661    5115 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-model-cache\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:37.589891 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589846    5115 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-home\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:37.589891 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.589716    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:37.591498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.591475    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:37.591701 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.591672    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "kube-api-access-4w4zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:37.591967 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.591943    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs" pod "1f296a7d-85a6-420f-a88a-8f818293e54d" (UID: "1f296a7d-85a6-420f-a88a-8f818293e54d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:37.690678 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.690624    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w4zs\" (UniqueName: \"kubernetes.io/projected/1f296a7d-85a6-420f-a88a-8f818293e54d-kube-api-access-4w4zs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:37.690678 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.690654    5115 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-dshm\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:37.690678 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.690664    5115 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f296a7d-85a6-420f-a88a-8f818293e54d-tls-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:37.690941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:37.690691    5115 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f296a7d-85a6-420f-a88a-8f818293e54d-tmp-dir\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.138891 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.138858    5115 generic.go:356] "Generic (PLEG): container finished" podID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerID="712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea" exitCode=0
Oct 30 21:02:38.139064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.139032    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" event={"ID":"1f296a7d-85a6-420f-a88a-8f818293e54d","Type":"ContainerDied","Data":"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"}
Oct 30 21:02:38.139064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.139059    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp" event={"ID":"1f296a7d-85a6-420f-a88a-8f818293e54d","Type":"ContainerDied","Data":"42b19ff7b6e4dc169e9bef4700d6af5dc20321e117edf5d7e2d2789a3ab51979"}
Oct 30 21:02:38.139140 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.139075    5115 scope.go:122] "RemoveContainer" containerID="712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"
Oct 30 21:02:38.139203 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.139192    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"
Oct 30 21:02:38.149939 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.149920    5115 scope.go:122] "RemoveContainer" containerID="712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"
Oct 30 21:02:38.150206 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:02:38.150188    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea\": container with ID starting with 712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea not found: ID does not exist" containerID="712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"
Oct 30 21:02:38.150261 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.150213    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea"} err="failed to get container status \"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea\": rpc error: code = NotFound desc = could not find container \"712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea\": container with ID starting with 712653b86d5371b144a53fbaeb920fda2548aac9955e2f8569e3330dc566dbea not found: ID does not exist"
Oct 30 21:02:38.177280 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.177255    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 21:02:38.187404 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.187379    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f2ed1e/premium-w4-f2ed1e-kserve-58f659c6c-5r5dp"]
Oct 30 21:02:38.367791 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:38.367750    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" path="/var/lib/kubelet/pods/1f296a7d-85a6-420f-a88a-8f818293e54d/volumes"
Oct 30 21:02:49.972674 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.972584    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 21:02:49.973092 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.972805    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" containerID="cri-o://bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537" gracePeriod=30
Oct 30 21:02:49.985411 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.985377    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 21:02:49.985648 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.985625    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy" containerID="cri-o://3b2cfbce8f9d21b42cd260cfa1105b11f6c0210f915fe2aacf6e76b6fb334419" gracePeriod=30
Oct 30 21:02:49.993717 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.993691    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 21:02:49.993913 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:49.993894    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" containerID="cri-o://a45cdae4fcd189e966b96685e4e528a686b24e395c1206982ffa30bf6eba1290" gracePeriod=30
Oct 30 21:02:53.709254 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:53.709211    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:53.709773 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:53.709298    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:55.061615 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.061584    5115 patch_prober.go:29] interesting pod/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:02:55.061950 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.061634    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:02:55.270558 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.261440    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 21:02:55.274870 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.274827    5115 generic.go:356] "Generic (PLEG): container finished" podID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerID="a45cdae4fcd189e966b96685e4e528a686b24e395c1206982ffa30bf6eba1290" exitCode=0
Oct 30 21:02:55.275025 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.274909    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" event={"ID":"bf7a5906-0fa1-4c77-8792-ccca15f52d56","Type":"ContainerDied","Data":"a45cdae4fcd189e966b96685e4e528a686b24e395c1206982ffa30bf6eba1290"}
Oct 30 21:02:55.278629 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.278077    5115 generic.go:356] "Generic (PLEG): container finished" podID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerID="3b2cfbce8f9d21b42cd260cfa1105b11f6c0210f915fe2aacf6e76b6fb334419" exitCode=0
Oct 30 21:02:55.278629 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.278157    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" event={"ID":"bc03e853-e381-4d38-a47b-2ee6c6e6cb43","Type":"ContainerDied","Data":"3b2cfbce8f9d21b42cd260cfa1105b11f6c0210f915fe2aacf6e76b6fb334419"}
Oct 30 21:02:55.279814 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.279788    5115 generic.go:356] "Generic (PLEG): container finished" podID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerID="bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537" exitCode=0
Oct 30 21:02:55.279927 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.279853    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" event={"ID":"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef","Type":"ContainerDied","Data":"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"}
Oct 30 21:02:55.279927 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.279888    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9" event={"ID":"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef","Type":"ContainerDied","Data":"633f59c97b3f4899fbb44483b3c66a642d1ea39a38664ec952f5b200db97cfb1"}
Oct 30 21:02:55.279927 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.279913    5115 scope.go:122] "RemoveContainer" containerID="bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"
Oct 30 21:02:55.280043 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.280030    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"
Oct 30 21:02:55.303814 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.303792    5115 scope.go:122] "RemoveContainer" containerID="bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"
Oct 30 21:02:55.304211 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:02:55.304168    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537\": container with ID starting with bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537 not found: ID does not exist" containerID="bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"
Oct 30 21:02:55.304321 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.304222    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537"} err="failed to get container status \"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537\": rpc error: code = NotFound desc = could not find container \"bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537\": container with ID starting with bdf4aefbc0e734b8e8e981d35c61afcd51451b3c779232afd93d2507b549a537 not found: ID does not exist"
Oct 30 21:02:55.309202 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.309177    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 21:02:55.325415 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.325391    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 21:02:55.404937 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.404903    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405115 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.404950    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405115 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.404990    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405115 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405021    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405115 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405055    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405320 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405119    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405320 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405194    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405320 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405232    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.405320 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405269    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405320 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405303    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\") pod \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\" (UID: \"1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef\") "
Oct 30 21:02:55.405607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405352    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.405607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405450    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:55.405607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405466    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.405607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405568    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.405796 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405773    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.405848 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405803    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.405848 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405818    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.405848 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405830    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.405848 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.405842    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.407431 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.407408    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.407517 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.407445    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:55.407746 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.407726    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.407746 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.407736    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk" pod "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" (UID: "1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef"). InnerVolumeSpecName "kube-api-access-4rdmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.506278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506178    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.506278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506218    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.506278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506263    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.506654 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506629    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:55.506751 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506719    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.506813 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506769    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.506813 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506802    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.506926 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506853    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.506926 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506895    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.507038 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.506994    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507038 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507005    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.507038 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507033    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.507201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507070    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.507201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507088    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507106    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507137    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507201 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507171    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507467 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507200    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507467 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507252    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\") pod \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\" (UID: \"bf7a5906-0fa1-4c77-8792-ccca15f52d56\") "
Oct 30 21:02:55.507467 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507292    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\") pod \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\" (UID: \"bc03e853-e381-4d38-a47b-2ee6c6e6cb43\") "
Oct 30 21:02:55.507641 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507581    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:55.507933 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507905    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.507933 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507922    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507945    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507975    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.507997    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.508014    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.508030    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.508046    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rdmk\" (UniqueName: \"kubernetes.io/projected/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef-kube-api-access-4rdmk\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.508382 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.508262    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.508861    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509004    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509030    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509079    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.509275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509231    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509671 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509369    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:55.509671 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509510    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509671 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509578    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.509671 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.509607    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:55.510301 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.510280    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp" pod "bf7a5906-0fa1-4c77-8792-ccca15f52d56" (UID: "bf7a5906-0fa1-4c77-8792-ccca15f52d56"). InnerVolumeSpecName "kube-api-access-768lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.510394 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.510368    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "kube-api-access-8mdlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.510684 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.510666    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.511097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.511072    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo" pod "bc03e853-e381-4d38-a47b-2ee6c6e6cb43" (UID: "bc03e853-e381-4d38-a47b-2ee6c6e6cb43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:55.609439 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.605797    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 21:02:55.612788 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.612759    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.612935 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.612923    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613027 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613016    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613110 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613099    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613183 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613173    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613256 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613246    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mdlp\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-kube-api-access-8mdlp\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613322    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613409 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613399    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613495 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613470    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613491    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613574    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613649 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613600    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613847 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613827    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-768lp\" (UniqueName: \"kubernetes.io/projected/bf7a5906-0fa1-4c77-8792-ccca15f52d56-kube-api-access-768lp\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613906 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613854    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf7a5906-0fa1-4c77-8792-ccca15f52d56-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.613906 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.613872    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc03e853-e381-4d38-a47b-2ee6c6e6cb43-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.614598 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:55.614577    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9s7r9"]
Oct 30 21:02:56.286597 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.286555    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg" event={"ID":"bc03e853-e381-4d38-a47b-2ee6c6e6cb43","Type":"ContainerDied","Data":"def510819ab33c7a5b2dddf406709e1a07990dbed943d680c1832414a7b07f47"}
Oct 30 21:02:56.286597 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.286595    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"
Oct 30 21:02:56.287119 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.286656    5115 scope.go:122] "RemoveContainer" containerID="3b2cfbce8f9d21b42cd260cfa1105b11f6c0210f915fe2aacf6e76b6fb334419"
Oct 30 21:02:56.289214 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.289178    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"
Oct 30 21:02:56.289361 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.289215    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z" event={"ID":"bf7a5906-0fa1-4c77-8792-ccca15f52d56","Type":"ContainerDied","Data":"f67b0a1a2a0a85a39b8f317f66a80ea9124c66bdea85350f5c64226160883470"}
Oct 30 21:02:56.297426 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.297407    5115 scope.go:122] "RemoveContainer" containerID="a45cdae4fcd189e966b96685e4e528a686b24e395c1206982ffa30bf6eba1290"
Oct 30 21:02:56.309707 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.309677    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 21:02:56.316254 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.316233    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-7bzrg"]
Oct 30 21:02:56.326554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.326511    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 21:02:56.333938 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.333916    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f2ed1e-openshift-default-7694b65f87-9qs2z"]
Oct 30 21:02:56.368029 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.367999    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" path="/var/lib/kubelet/pods/1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef/volumes"
Oct 30 21:02:56.368460 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.368447    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" path="/var/lib/kubelet/pods/bc03e853-e381-4d38-a47b-2ee6c6e6cb43/volumes"
Oct 30 21:02:56.368903 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:02:56.368890    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" path="/var/lib/kubelet/pods/bf7a5906-0fa1-4c77-8792-ccca15f52d56/volumes"
Oct 30 21:03:02.822449 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:02.822414    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 21:03:02.822898 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:02.822628    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-54df5bbf78-7m69q" podUID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" containerName="manager" containerID="cri-o://7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311" gracePeriod=30
Oct 30 21:03:03.083228 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.083169    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 21:03:03.188889 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.188858    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\" (UniqueName: \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\") pod \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") "
Oct 30 21:03:03.189055 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.188952    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\") pod \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") "
Oct 30 21:03:03.189055 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.188994    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\") pod \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\" (UID: \"230d4017-a4cd-43d7-ab4a-b8f3f7216997\") "
Oct 30 21:03:03.190903 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.190875    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert" pod "230d4017-a4cd-43d7-ab4a-b8f3f7216997" (UID: "230d4017-a4cd-43d7-ab4a-b8f3f7216997"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:03.191030 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.190986    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2" pod "230d4017-a4cd-43d7-ab4a-b8f3f7216997" (UID: "230d4017-a4cd-43d7-ab4a-b8f3f7216997"). InnerVolumeSpecName "kube-api-access-98rp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:03.191073 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.191042    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs" pod "230d4017-a4cd-43d7-ab4a-b8f3f7216997" (UID: "230d4017-a4cd-43d7-ab4a-b8f3f7216997"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:03.290921 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.290879    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rp2\" (UniqueName: \"kubernetes.io/projected/230d4017-a4cd-43d7-ab4a-b8f3f7216997-kube-api-access-98rp2\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:03.290921 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.290920    5115 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-webhook-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:03.291125 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.290937    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/230d4017-a4cd-43d7-ab4a-b8f3f7216997-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:03.333508 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.333411    5115 generic.go:356] "Generic (PLEG): container finished" podID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" containerID="7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311" exitCode=0
Oct 30 21:03:03.333508 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.333456    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-7m69q"
Oct 30 21:03:03.333508 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.333469    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-7m69q" event={"ID":"230d4017-a4cd-43d7-ab4a-b8f3f7216997","Type":"ContainerDied","Data":"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"}
Oct 30 21:03:03.333847 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.333510    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-7m69q" event={"ID":"230d4017-a4cd-43d7-ab4a-b8f3f7216997","Type":"ContainerDied","Data":"9a529f426d0e2b1351bc0d0dd51a149539156fd4ca0461a7f9cf82e11039d6de"}
Oct 30 21:03:03.333847 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.333544    5115 scope.go:122] "RemoveContainer" containerID="7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"
Oct 30 21:03:03.344665 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.344647    5115 scope.go:122] "RemoveContainer" containerID="7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"
Oct 30 21:03:03.344943 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:03:03.344925    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311\": container with ID starting with 7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311 not found: ID does not exist" containerID="7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"
Oct 30 21:03:03.344986 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.344951    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311"} err="failed to get container status \"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311\": rpc error: code = NotFound desc = could not find container \"7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311\": container with ID starting with 7fa3a4cf6720c6673483bf0e6cc8a0785076caee56ed4b076204d3e3a4fa7311 not found: ID does not exist"
Oct 30 21:03:03.356984 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.356960    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 21:03:03.363309 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:03.363287    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-7m69q"]
Oct 30 21:03:04.069817 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.069781    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:04.070252 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070239    5115 cpu_manager.go:414] "containerMap: removing container" podUID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" containerName="manager"
Oct 30 21:03:04.070292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070254    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" containerName="manager"
Oct 30 21:03:04.070292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070264    5115 cpu_manager.go:414] "containerMap: removing container" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy"
Oct 30 21:03:04.070292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070272    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy"
Oct 30 21:03:04.070292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070283    5115 cpu_manager.go:414] "containerMap: removing container" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy"
Oct 30 21:03:04.070292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070288    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070299    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070304    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070318    5115 cpu_manager.go:414] "containerMap: removing container" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070323    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070332    5115 cpu_manager.go:414] "containerMap: removing container" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070336    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070346    5115 cpu_manager.go:414] "containerMap: removing container" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070352    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070359    5115 cpu_manager.go:414] "containerMap: removing container" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070363    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070372    5115 cpu_manager.go:414] "containerMap: removing container" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070377    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070389    5115 cpu_manager.go:414] "containerMap: removing container" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070393    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070400    5115 cpu_manager.go:414] "containerMap: removing container" podUID="5b39ef8e-59aa-44e1-9268-f035458aaf62" containerName="maas-api"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070404    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b39ef8e-59aa-44e1-9268-f035458aaf62" containerName="maas-api"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070410    5115 cpu_manager.go:414] "containerMap: removing container" podUID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" containerName="payload-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070414    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" containerName="payload-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070422    5115 cpu_manager.go:414] "containerMap: removing container" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070427    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070433    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" containerName="payload-pre-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070437    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" containerName="payload-pre-processing"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070443    5115 cpu_manager.go:414] "containerMap: removing container" podUID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" containerName="maas-api"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070448    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" containerName="maas-api"
Oct 30 21:03:04.070443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070455    5115 cpu_manager.go:414] "containerMap: removing container" podUID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" containerName="maas-api"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070459    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" containerName="maas-api"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070467    5115 cpu_manager.go:414] "containerMap: removing container" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070472    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070477    5115 cpu_manager.go:414] "containerMap: removing container" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070481    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070577    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4c00f0b-d283-4e9f-a7aa-03eab3ca3ff4" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070588    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f296a7d-85a6-420f-a88a-8f818293e54d" containerName="main"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070596    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e747449-02be-4dff-9486-665f5bc54c6d" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070603    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf7a5906-0fa1-4c77-8792-ccca15f52d56" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070609    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="03826521-fb34-4e9b-ab13-bde04b1beb29" containerName="payload-processing"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070615    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="873c7a86-ec41-43d3-b2db-8789ca4de288" containerName="payload-pre-processing"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070622    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b39ef8e-59aa-44e1-9268-f035458aaf62" containerName="maas-api"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070627    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4bc25e6-edf8-4933-86e2-7c9959b3ebea" containerName="payload-processing"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070633    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc03e853-e381-4d38-a47b-2ee6c6e6cb43" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070638    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b1ff3ef-247b-40b0-b4cf-64106dadb1bf" containerName="payload-pre-processing"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070644    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ffc3f6-7f73-40da-a3e6-d68d72db9774" containerName="maas-api"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070650    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="279b438d-f6b0-4b2a-8ac8-d0fe1490c313" containerName="maas-api"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070654    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="74a7f94d-774e-4d1f-b51b-edee859f2919" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070659    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ebdfff8-d160-4f26-b62c-0de75c84673b" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070667    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" containerName="manager"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070672    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="11dc7685-6491-4e40-88b6-a8b1e1886382" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070677    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0d01618-f816-421d-9cbd-7d73db71c606" containerName="istio-proxy"
Oct 30 21:03:04.071193 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.070682    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a9363a9-df6f-43a7-82c1-4c8b1ba3d4ef" containerName="istio-proxy"
Oct 30 21:03:04.075369 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.075352    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.084987 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.084000    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:03:04.084987 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.084029    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dnlkn\""
Oct 30 21:03:04.084987 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.084062    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:03:04.084987 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.084933    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:03:04.087690 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.087668    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:04.099660 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.099636    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.099777 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.099667    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.099859 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.099801    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdpf\" (UniqueName: \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.201392 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.201360    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdpf\" (UniqueName: \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.201572 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.201458    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.201572 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.201477    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.203854 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.203831    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.203980 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.203958    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.214611 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.214590    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdpf\" (UniqueName: \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\") pod \"maas-controller-54df5bbf78-pnpz5\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") " pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.371446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.371351    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="230d4017-a4cd-43d7-ab4a-b8f3f7216997" path="/var/lib/kubelet/pods/230d4017-a4cd-43d7-ab4a-b8f3f7216997/volumes"
Oct 30 21:03:04.390348 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.390319    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:04.691099 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.691072    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:04.694958 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:03:04.694929    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5947ec6_a8da_4613_9786_eadc39904a24.slice/crio-7e3adb608919319fceffde938717c37344c5d76c315df740d07ba541d4e972f7 WatchSource:0}: Error finding container 7e3adb608919319fceffde938717c37344c5d76c315df740d07ba541d4e972f7: Status 404 returned error can't find the container with id 7e3adb608919319fceffde938717c37344c5d76c315df740d07ba541d4e972f7
Oct 30 21:03:04.696958 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:04.696937    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:03:05.380333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:05.379451    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" event={"ID":"d5947ec6-a8da-4613-9786-eadc39904a24","Type":"ContainerStarted","Data":"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"}
Oct 30 21:03:05.380333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:05.379513    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" event={"ID":"d5947ec6-a8da-4613-9786-eadc39904a24","Type":"ContainerStarted","Data":"7e3adb608919319fceffde938717c37344c5d76c315df740d07ba541d4e972f7"}
Oct 30 21:03:05.380333 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:05.380282    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:05.410575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:05.410299    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" podStartSLOduration=0.91990814 podStartE2EDuration="1.410279778s" totalImagesPullingTime="490.371638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:05.406441406 +0000 UTC m=+1447.210336174" watchObservedRunningTime="2026-10-30 21:03:05.410279778 +0000 UTC m=+1447.214174537"
Oct 30 21:03:06.339664 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:03:06.339625    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:03:17.420223 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:17.420191    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:36.280476 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:03:36.280432    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:03:36.504842 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.504806    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:36.505204 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.505081    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" podUID="d5947ec6-a8da-4613-9786-eadc39904a24" containerName="manager" containerID="cri-o://bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490" gracePeriod=30
Oct 30 21:03:36.766287 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.766257    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:36.870607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.870049    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\") pod \"d5947ec6-a8da-4613-9786-eadc39904a24\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") "
Oct 30 21:03:36.870607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.870258    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\") pod \"d5947ec6-a8da-4613-9786-eadc39904a24\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") "
Oct 30 21:03:36.870607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.870306    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\" (UniqueName: \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\") pod \"d5947ec6-a8da-4613-9786-eadc39904a24\" (UID: \"d5947ec6-a8da-4613-9786-eadc39904a24\") "
Oct 30 21:03:36.875138 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.874829    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf" pod "d5947ec6-a8da-4613-9786-eadc39904a24" (UID: "d5947ec6-a8da-4613-9786-eadc39904a24"). InnerVolumeSpecName "kube-api-access-sbdpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:36.877514 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.877254    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs" pod "d5947ec6-a8da-4613-9786-eadc39904a24" (UID: "d5947ec6-a8da-4613-9786-eadc39904a24"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:36.879679 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.879490    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert" pod "d5947ec6-a8da-4613-9786-eadc39904a24" (UID: "d5947ec6-a8da-4613-9786-eadc39904a24"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:36.973350 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.973309    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbdpf\" (UniqueName: \"kubernetes.io/projected/d5947ec6-a8da-4613-9786-eadc39904a24-kube-api-access-sbdpf\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:36.973350 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.973343    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:36.973350 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:36.973353    5115 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5947ec6-a8da-4613-9786-eadc39904a24-webhook-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:37.603095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.603063    5115 generic.go:356] "Generic (PLEG): container finished" podID="d5947ec6-a8da-4613-9786-eadc39904a24" containerID="bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490" exitCode=0
Oct 30 21:03:37.603554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.603117    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" event={"ID":"d5947ec6-a8da-4613-9786-eadc39904a24","Type":"ContainerDied","Data":"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"}
Oct 30 21:03:37.603554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.603130    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-pnpz5"
Oct 30 21:03:37.603554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.603156    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-pnpz5" event={"ID":"d5947ec6-a8da-4613-9786-eadc39904a24","Type":"ContainerDied","Data":"7e3adb608919319fceffde938717c37344c5d76c315df740d07ba541d4e972f7"}
Oct 30 21:03:37.603554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.603177    5115 scope.go:122] "RemoveContainer" containerID="bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"
Oct 30 21:03:37.614112 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.614088    5115 scope.go:122] "RemoveContainer" containerID="bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"
Oct 30 21:03:37.614405 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:03:37.614388    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490\": container with ID starting with bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490 not found: ID does not exist" containerID="bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"
Oct 30 21:03:37.614454 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.614415    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490"} err="failed to get container status \"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490\": rpc error: code = NotFound desc = could not find container \"bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490\": container with ID starting with bbf8a4b0824776aee7eefbcc1b97ef812f60272a7c40fe2ca43a60c03f341490 not found: ID does not exist"
Oct 30 21:03:37.640368 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.640336    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:37.648689 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:37.648662    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-pnpz5"]
Oct 30 21:03:38.369214 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:38.369181    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5947ec6-a8da-4613-9786-eadc39904a24" path="/var/lib/kubelet/pods/d5947ec6-a8da-4613-9786-eadc39904a24/volumes"
Oct 30 21:03:48.890438 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.890402    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54df5bbf78-sjqgq"]
Oct 30 21:03:48.890913 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.890898    5115 cpu_manager.go:414] "containerMap: removing container" podUID="d5947ec6-a8da-4613-9786-eadc39904a24" containerName="manager"
Oct 30 21:03:48.890913 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.890913    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5947ec6-a8da-4613-9786-eadc39904a24" containerName="manager"
Oct 30 21:03:48.891042 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.891032    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5947ec6-a8da-4613-9786-eadc39904a24" containerName="manager"
Oct 30 21:03:48.893082 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.893066    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:48.899318 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.899290    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dnlkn\""
Oct 30 21:03:48.906550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.904372    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:03:48.908808 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:48.908236    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-sjqgq"]
Oct 30 21:03:49.000621 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.000583    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:03:49.000621 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.000583    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:03:49.005055 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.005026    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-metrics-certs\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.005181 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.005165    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6mth\" (UniqueName: \"kubernetes.io/projected/b6e32908-0f79-447c-bd5a-3619a889d392-kube-api-access-m6mth\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.005242 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.005228    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-webhook-cert\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.106837 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.106797    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6mth\" (UniqueName: \"kubernetes.io/projected/b6e32908-0f79-447c-bd5a-3619a889d392-kube-api-access-m6mth\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.107009 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.106878    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-webhook-cert\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.107009 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.106916    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-metrics-certs\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.109410 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.109382    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-webhook-cert\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.109537 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.109430    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6e32908-0f79-447c-bd5a-3619a889d392-metrics-certs\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.118974 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.118948    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6mth\" (UniqueName: \"kubernetes.io/projected/b6e32908-0f79-447c-bd5a-3619a889d392-kube-api-access-m6mth\") pod \"maas-controller-54df5bbf78-sjqgq\" (UID: \"b6e32908-0f79-447c-bd5a-3619a889d392\") " pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.228276 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.228174    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:49.511612 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.511585    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54df5bbf78-sjqgq"]
Oct 30 21:03:49.513617 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:03:49.513593    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e32908_0f79_447c_bd5a_3619a889d392.slice/crio-8faa2643250d20f3facaeb885e93d236f6020243f10ccc89065251af1e8b3760 WatchSource:0}: Error finding container 8faa2643250d20f3facaeb885e93d236f6020243f10ccc89065251af1e8b3760: Status 404 returned error can't find the container with id 8faa2643250d20f3facaeb885e93d236f6020243f10ccc89065251af1e8b3760
Oct 30 21:03:49.678580 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:49.678547    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-sjqgq" event={"ID":"b6e32908-0f79-447c-bd5a-3619a889d392","Type":"ContainerStarted","Data":"8faa2643250d20f3facaeb885e93d236f6020243f10ccc89065251af1e8b3760"}
Oct 30 21:03:50.685920 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:50.685886    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54df5bbf78-sjqgq" event={"ID":"b6e32908-0f79-447c-bd5a-3619a889d392","Type":"ContainerStarted","Data":"a9f335dccb1cb9fcc4a3866e0779e1675d6371b8c98a84d8292a7a5791f953b4"}
Oct 30 21:03:50.686328 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:50.685993    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:03:50.705926 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:50.705865    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-54df5bbf78-sjqgq" podStartSLOduration=2.255979322 podStartE2EDuration="2.705852652s" totalImagesPullingTime="449.87333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:50.704848477 +0000 UTC m=+1492.508743256" watchObservedRunningTime="2026-10-30 21:03:50.705852652 +0000 UTC m=+1492.509747408"
Oct 30 21:03:59.167900 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:59.167873    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:03:59.306640 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:03:59.306616    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:04:01.694465 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:04:01.694432    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54df5bbf78-sjqgq"
Oct 30 21:04:06.279695 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:04:06.279656    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:04:36.279284 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:04:36.279245    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:05:06.279235 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:05:06.279194    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:05:36.279214 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:05:36.279122    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:06:06.278873 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:06:06.278834    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:06:15.983684 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:15.983645    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 21:06:15.984213 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:15.983854    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerName="discovery" containerID="cri-o://a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc" gracePeriod=30
Oct 30 21:06:16.246316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.246261    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 21:06:16.336121 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336093    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336131    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336156    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336203    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336245    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336316 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336263    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336652 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336325    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\") pod \"ccb30b50-5fce-4b15-be61-6ed645814cd3\" (UID: \"ccb30b50-5fce-4b15-be61-6ed645814cd3\") "
Oct 30 21:06:16.336806 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.336775    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:16.338402 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338359    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:16.338574 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338507    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:16.338735 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338714    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:16.338852 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338818    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:16.338852 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338833    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:16.338982 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.338963    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9" pod "ccb30b50-5fce-4b15-be61-6ed645814cd3" (UID: "ccb30b50-5fce-4b15-be61-6ed645814cd3"). InnerVolumeSpecName "kube-api-access-fk8v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:16.437795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437766    5115 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-kubeconfig\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.437795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437791    5115 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-ca-configmap\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.437795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437802    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk8v9\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-kube-api-access-fk8v9\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.438064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437811    5115 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb30b50-5fce-4b15-be61-6ed645814cd3-local-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.438064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437821    5115 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-csr-dns-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.438064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437830    5115 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccb30b50-5fce-4b15-be61-6ed645814cd3-cacerts\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.438064 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.437838    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb30b50-5fce-4b15-be61-6ed645814cd3-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:16.724624 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.724582    5115 generic.go:356] "Generic (PLEG): container finished" podID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerID="a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc" exitCode=0
Oct 30 21:06:16.724827 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.724641    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"
Oct 30 21:06:16.724827 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.724666    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" event={"ID":"ccb30b50-5fce-4b15-be61-6ed645814cd3","Type":"ContainerDied","Data":"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"}
Oct 30 21:06:16.724827 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.724717    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq" event={"ID":"ccb30b50-5fce-4b15-be61-6ed645814cd3","Type":"ContainerDied","Data":"d8cace61d311bf0aa31c0fc2918d75a52f9dad3851f0177f9727b9814127f59e"}
Oct 30 21:06:16.724827 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.724736    5115 scope.go:122] "RemoveContainer" containerID="a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"
Oct 30 21:06:16.740463 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.740440    5115 scope.go:122] "RemoveContainer" containerID="a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"
Oct 30 21:06:16.740798 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:06:16.740769    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc\": container with ID starting with a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc not found: ID does not exist" containerID="a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"
Oct 30 21:06:16.740875 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.740809    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc"} err="failed to get container status \"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc\": rpc error: code = NotFound desc = could not find container \"a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc\": container with ID starting with a4ea331941d2106e778984ac764aa0d8f31e58b856d31120b51be14aa9306fbc not found: ID does not exist"
Oct 30 21:06:16.746150 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.746127    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 21:06:16.756471 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:16.756441    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5lhdq"]
Oct 30 21:06:18.367732 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:06:18.367698    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" path="/var/lib/kubelet/pods/ccb30b50-5fce-4b15-be61-6ed645814cd3/volumes"
Oct 30 21:06:36.279102 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:06:36.279062    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:07:06.279351 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:07:06.279306    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:07:36.278890 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:07:36.278854    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:08:06.278938 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:08:06.278898    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:08:10.018779 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:08:10.018692    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:10.019194 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:08:10.018798    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:36.278936 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:08:36.278897    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:08:59.208585 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:08:59.208555    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:08:59.347319 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:08:59.347292    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:09:06.279326 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:09:06.279289    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:09:17.398830 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.398788    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:09:17.399383 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.399362    5115 cpu_manager.go:414] "containerMap: removing container" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerName="discovery"
Oct 30 21:09:17.399383 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.399381    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerName="discovery"
Oct 30 21:09:17.399568 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.399484    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccb30b50-5fce-4b15-be61-6ed645814cd3" containerName="discovery"
Oct 30 21:09:17.403251 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.403227    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.418867 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.418840    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:09:17.420035 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.419594    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-1c4642-serving-cert\""
Oct 30 21:09:17.489724 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.489689    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbxz9\" (UniqueName: \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.489920 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.489744    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.489979 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.489908    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.490071 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.490049    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.591566 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.591519    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.591761 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.591597    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.591761 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.591658    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.591761 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.591714    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbxz9\" (UniqueName: \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.592970 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.592942    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.595586 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.595555    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.596009 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.595987    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.604322 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.604295    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbxz9\" (UniqueName: \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\") pod \"maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:17.728518 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:17.728423    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:18.013461 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.013430    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:09:18.015654 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:09:18.015623    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460160e7_223c_4f09_a553_b79b0fef94f7.slice/crio-c005d0541c933dbba635b970aff8218b05c2b0ff7fc7b66d5a0a60c03072118f WatchSource:0}: Error finding container c005d0541c933dbba635b970aff8218b05c2b0ff7fc7b66d5a0a60c03072118f: Status 404 returned error can't find the container with id c005d0541c933dbba635b970aff8218b05c2b0ff7fc7b66d5a0a60c03072118f
Oct 30 21:09:18.017383 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.017365    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:09:18.974318 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.974281    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" event={"ID":"460160e7-223c-4f09-a553-b79b0fef94f7","Type":"ContainerStarted","Data":"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"}
Oct 30 21:09:18.974778 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.974336    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" event={"ID":"460160e7-223c-4f09-a553-b79b0fef94f7","Type":"ContainerStarted","Data":"c005d0541c933dbba635b970aff8218b05c2b0ff7fc7b66d5a0a60c03072118f"}
Oct 30 21:09:18.974778 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.974412    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:18.996679 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:18.996623    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" podStartSLOduration=1.540548351 podStartE2EDuration="1.996602233s" totalImagesPullingTime="456.053882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:18.99398669 +0000 UTC m=+1820.797881446" watchObservedRunningTime="2026-10-30 21:09:18.996602233 +0000 UTC m=+1820.800496988"
Oct 30 21:09:24.985924 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:09:24.985852    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:09:36.282188 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:09:36.282150    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:10:06.280389 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:10:06.280347    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:10:19.849273 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:19.849229    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:10:19.849988 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:19.849595    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" containerName="maas-api" containerID="cri-o://9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889" gracePeriod=30
Oct 30 21:10:19.980817 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:19.980780    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.128:8443/health\": dial tcp 10.132.0.128:8443: connect: connection refused"
Oct 30 21:10:20.130441 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.130407    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:10:20.234559 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.234499    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\") pod \"460160e7-223c-4f09-a553-b79b0fef94f7\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") "
Oct 30 21:10:20.234734 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.234701    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\") pod \"460160e7-223c-4f09-a553-b79b0fef94f7\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") "
Oct 30 21:10:20.234798 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.234763    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\") pod \"460160e7-223c-4f09-a553-b79b0fef94f7\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") "
Oct 30 21:10:20.234857 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.234826    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\" (UniqueName: \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\") pod \"460160e7-223c-4f09-a553-b79b0fef94f7\" (UID: \"460160e7-223c-4f09-a553-b79b0fef94f7\") "
Oct 30 21:10:20.234915 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.234847    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca" pod "460160e7-223c-4f09-a553-b79b0fef94f7" (UID: "460160e7-223c-4f09-a553-b79b0fef94f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:10:20.235175 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.235152    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/460160e7-223c-4f09-a553-b79b0fef94f7-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:10:20.238620 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.237649    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs" pod "460160e7-223c-4f09-a553-b79b0fef94f7" (UID: "460160e7-223c-4f09-a553-b79b0fef94f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:10:20.238620 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.238306    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls" pod "460160e7-223c-4f09-a553-b79b0fef94f7" (UID: "460160e7-223c-4f09-a553-b79b0fef94f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:10:20.240331 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.240303    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9" pod "460160e7-223c-4f09-a553-b79b0fef94f7" (UID: "460160e7-223c-4f09-a553-b79b0fef94f7"). InnerVolumeSpecName "kube-api-access-zbxz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:20.336945 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.336909    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:10:20.336945 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.336941    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/460160e7-223c-4f09-a553-b79b0fef94f7-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:10:20.336945 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.336951    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbxz9\" (UniqueName: \"kubernetes.io/projected/460160e7-223c-4f09-a553-b79b0fef94f7-kube-api-access-zbxz9\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:10:20.343738 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.343706    5115 generic.go:356] "Generic (PLEG): container finished" podID="460160e7-223c-4f09-a553-b79b0fef94f7" containerID="9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889" exitCode=0
Oct 30 21:10:20.343901 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.343757    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"
Oct 30 21:10:20.343901 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.343797    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" event={"ID":"460160e7-223c-4f09-a553-b79b0fef94f7","Type":"ContainerDied","Data":"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"}
Oct 30 21:10:20.343901 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.343849    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2" event={"ID":"460160e7-223c-4f09-a553-b79b0fef94f7","Type":"ContainerDied","Data":"c005d0541c933dbba635b970aff8218b05c2b0ff7fc7b66d5a0a60c03072118f"}
Oct 30 21:10:20.343901 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.343871    5115 scope.go:122] "RemoveContainer" containerID="9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"
Oct 30 21:10:20.358249 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.358224    5115 scope.go:122] "RemoveContainer" containerID="9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"
Oct 30 21:10:20.358717 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:10:20.358700    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889\": container with ID starting with 9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889 not found: ID does not exist" containerID="9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"
Oct 30 21:10:20.358785 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.358724    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889"} err="failed to get container status \"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889\": rpc error: code = NotFound desc = could not find container \"9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889\": container with ID starting with 9585b932fef7d968ac4cb1c82bdbb0b5bd5ef7d2ea4a393e472b370eb2188889 not found: ID does not exist"
Oct 30 21:10:20.368509 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.368478    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:10:20.368664 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:20.368539    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1c4642-5b4b64dd94-qg2n2"]
Oct 30 21:10:22.367238 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:10:22.367205    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" path="/var/lib/kubelet/pods/460160e7-223c-4f09-a553-b79b0fef94f7/volumes"
Oct 30 21:10:36.279309 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:10:36.279270    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:11:06.278013 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:11:06.277974    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:11:36.278375 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:11:36.278286    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:12:01.836847 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.836813    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"]
Oct 30 21:12:01.837365 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.837349    5115 cpu_manager.go:414] "containerMap: removing container" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" containerName="maas-api"
Oct 30 21:12:01.837418 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.837368    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" containerName="maas-api"
Oct 30 21:12:01.837456 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.837445    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="460160e7-223c-4f09-a553-b79b0fef94f7" containerName="maas-api"
Oct 30 21:12:01.840705 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.840685    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:01.847282 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.847258    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7xcmg\""
Oct 30 21:12:01.859495 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:01.859472    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"]
Oct 30 21:12:02.004202 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.004158    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwsf6\" (UniqueName: \"kubernetes.io/projected/d22ada80-1656-462c-8fcc-b295950c93b2-kube-api-access-mwsf6\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.004383 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.004306    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22ada80-1656-462c-8fcc-b295950c93b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.105550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.105458    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22ada80-1656-462c-8fcc-b295950c93b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.105703 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.105551    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwsf6\" (UniqueName: \"kubernetes.io/projected/d22ada80-1656-462c-8fcc-b295950c93b2-kube-api-access-mwsf6\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.105854 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.105831    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22ada80-1656-462c-8fcc-b295950c93b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.119340 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.119319    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwsf6\" (UniqueName: \"kubernetes.io/projected/d22ada80-1656-462c-8fcc-b295950c93b2-kube-api-access-mwsf6\") pod \"kuadrant-operator-controller-manager-678d87766f-dzntl\" (UID: \"d22ada80-1656-462c-8fcc-b295950c93b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.154731 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.154707    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.439810 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.439781    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"]
Oct 30 21:12:02.441622 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:12:02.441595    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22ada80_1656_462c_8fcc_b295950c93b2.slice/crio-94ca6e683262a84b5e05e9c467edc6c9c3653502ea16aa3d4f85b456c44099fd WatchSource:0}: Error finding container 94ca6e683262a84b5e05e9c467edc6c9c3653502ea16aa3d4f85b456c44099fd: Status 404 returned error can't find the container with id 94ca6e683262a84b5e05e9c467edc6c9c3653502ea16aa3d4f85b456c44099fd
Oct 30 21:12:02.978535 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.978495    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl" event={"ID":"d22ada80-1656-462c-8fcc-b295950c93b2","Type":"ContainerStarted","Data":"58153eee6b536c4e158bef933885bfa4aef2bbbba77de0695377ab66f30ac5e1"}
Oct 30 21:12:02.979042 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.978570    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:02.979042 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.978588    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl" event={"ID":"d22ada80-1656-462c-8fcc-b295950c93b2","Type":"ContainerStarted","Data":"94ca6e683262a84b5e05e9c467edc6c9c3653502ea16aa3d4f85b456c44099fd"}
Oct 30 21:12:02.999904 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:02.999855    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl" podStartSLOduration=1.9998424 podStartE2EDuration="1.9998424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:02.998362727 +0000 UTC m=+1984.802257502" watchObservedRunningTime="2026-10-30 21:12:02.9998424 +0000 UTC m=+1984.803737155"
Oct 30 21:12:06.278689 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:12:06.278644    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:12:13.989334 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:12:13.989301    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dzntl"
Oct 30 21:12:36.281426 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:12:36.281298    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:13:06.279130 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:13:06.279093    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:13:36.279102 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:13:36.279062    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:13:59.253150 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:13:59.253121    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:13:59.388278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:13:59.388250    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:14:06.279033 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:14:06.278995    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:14:36.280612 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:14:36.280506    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:15:06.279680 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:15:06.279639    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:15:10.020450 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:15:10.020403    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-dlnwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:15:10.021024 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:15:10.020488    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-dlnwn" podUID="ce13999b-0475-4547-82bd-8a29bd61ec66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:15:36.278976 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:15:36.278941    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:16:06.292655 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:16:06.292612    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:16:31.231550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:31.230644    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-k29kh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:16:31.231550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:31.230736    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:16:31.386707 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:31.386669    5115 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6db586dd6c-7cwww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:16:31.386916 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:31.386749    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:16:36.279493 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:16:36.279445    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:16:46.906561 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.906502    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"]
Oct 30 21:16:46.910428 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.910407    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:46.924713 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.924679    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"]
Oct 30 21:16:46.981335 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.981287    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-metrics-certs\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:46.981515 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.981484    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-maas-api-tls\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:46.981651 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.981582    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4e15f-0134-4530-bde5-f0ce441a13a5-openshift-service-ca\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:46.981728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:46.981669    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwt8z\" (UniqueName: \"kubernetes.io/projected/5ed4e15f-0134-4530-bde5-f0ce441a13a5-kube-api-access-lwt8z\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.083045 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.083005    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-maas-api-tls\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.083228 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.083058    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4e15f-0134-4530-bde5-f0ce441a13a5-openshift-service-ca\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.083228 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.083100    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwt8z\" (UniqueName: \"kubernetes.io/projected/5ed4e15f-0134-4530-bde5-f0ce441a13a5-kube-api-access-lwt8z\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.083228 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.083132    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-metrics-certs\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.083853 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.083825    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed4e15f-0134-4530-bde5-f0ce441a13a5-openshift-service-ca\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.085703 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.085681    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-maas-api-tls\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.085839 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.085819    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed4e15f-0134-4530-bde5-f0ce441a13a5-metrics-certs\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.094996 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.094966    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwt8z\" (UniqueName: \"kubernetes.io/projected/5ed4e15f-0134-4530-bde5-f0ce441a13a5-kube-api-access-lwt8z\") pod \"maas-api-6f84c677c8-kznhv\" (UID: \"5ed4e15f-0134-4530-bde5-f0ce441a13a5\") " pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.263581 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.263466    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:47.551728 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.551705    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"]
Oct 30 21:16:47.554674 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:16:47.554648    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed4e15f_0134_4530_bde5_f0ce441a13a5.slice/crio-c8b1c8d3f1f5a7ca754286cf3eaa96ee81c23677a116eb7f001c7889d9fdf7d4 WatchSource:0}: Error finding container c8b1c8d3f1f5a7ca754286cf3eaa96ee81c23677a116eb7f001c7889d9fdf7d4: Status 404 returned error can't find the container with id c8b1c8d3f1f5a7ca754286cf3eaa96ee81c23677a116eb7f001c7889d9fdf7d4
Oct 30 21:16:47.556416 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.556395    5115 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:16:47.925774 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:47.925682    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv" event={"ID":"5ed4e15f-0134-4530-bde5-f0ce441a13a5","Type":"ContainerStarted","Data":"c8b1c8d3f1f5a7ca754286cf3eaa96ee81c23677a116eb7f001c7889d9fdf7d4"}
Oct 30 21:16:48.933441 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:48.933399    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv" event={"ID":"5ed4e15f-0134-4530-bde5-f0ce441a13a5","Type":"ContainerStarted","Data":"ec7e67f0d5f3fa790d36a74de7e4fea1247b691188fc05e0e3ff1cf9aeace056"}
Oct 30 21:16:48.933968 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:48.933561    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:48.953358 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:48.953313    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv" podStartSLOduration=2.5481255860000003 podStartE2EDuration="2.95330067s" totalImagesPullingTime="405.175084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:48.951928329 +0000 UTC m=+2270.755823085" watchObservedRunningTime="2026-10-30 21:16:48.95330067 +0000 UTC m=+2270.757195427"
Oct 30 21:16:54.946866 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:54.946835    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f84c677c8-kznhv"
Oct 30 21:16:55.003893 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:55.003857    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 21:16:55.004097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:55.004072    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerName="maas-api" containerID="cri-o://6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f" gracePeriod=30
Oct 30 21:16:55.179786 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:55.179743    5115 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.58:8443/health\": dial tcp 10.132.0.58:8443: connect: connection refused"
Oct 30 21:16:56.274802 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.274769    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 21:16:56.376795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.376714    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\") pod \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") "
Oct 30 21:16:56.376795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.376762    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\") pod \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") "
Oct 30 21:16:56.377095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.376939    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\") pod \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") "
Oct 30 21:16:56.377095 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.377043    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\" (UniqueName: \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\") pod \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\" (UID: \"5990cf8b-b58b-4096-a31a-bee92a8f29a9\") "
Oct 30 21:16:56.377902 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.377753    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca" pod "5990cf8b-b58b-4096-a31a-bee92a8f29a9" (UID: "5990cf8b-b58b-4096-a31a-bee92a8f29a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:56.380658 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.379942    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls" pod "5990cf8b-b58b-4096-a31a-bee92a8f29a9" (UID: "5990cf8b-b58b-4096-a31a-bee92a8f29a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:16:56.380658 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.379973    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs" pod "5990cf8b-b58b-4096-a31a-bee92a8f29a9" (UID: "5990cf8b-b58b-4096-a31a-bee92a8f29a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:16:56.381474 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.381443    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn" pod "5990cf8b-b58b-4096-a31a-bee92a8f29a9" (UID: "5990cf8b-b58b-4096-a31a-bee92a8f29a9"). InnerVolumeSpecName "kube-api-access-lbjpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:56.478886 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.478842    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5990cf8b-b58b-4096-a31a-bee92a8f29a9-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:56.478886 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.478885    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:56.479108 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.478901    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5990cf8b-b58b-4096-a31a-bee92a8f29a9-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:56.479108 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.478915    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbjpn\" (UniqueName: \"kubernetes.io/projected/5990cf8b-b58b-4096-a31a-bee92a8f29a9-kube-api-access-lbjpn\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:56.981236 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.981196    5115 generic.go:356] "Generic (PLEG): container finished" podID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerID="6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f" exitCode=0
Oct 30 21:16:56.981443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.981240    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4"
Oct 30 21:16:56.981443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.981248    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" event={"ID":"5990cf8b-b58b-4096-a31a-bee92a8f29a9","Type":"ContainerDied","Data":"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"}
Oct 30 21:16:56.981443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.981299    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5db654b954-64xd4" event={"ID":"5990cf8b-b58b-4096-a31a-bee92a8f29a9","Type":"ContainerDied","Data":"3b7cf70e736734f5e933d6b9d8c6fa9367e94c13cb4f8c679b67615484dfd21d"}
Oct 30 21:16:56.981443 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.981330    5115 scope.go:122] "RemoveContainer" containerID="6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"
Oct 30 21:16:56.993589 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.993568    5115 scope.go:122] "RemoveContainer" containerID="6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"
Oct 30 21:16:56.993879 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:16:56.993856    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f\": container with ID starting with 6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f not found: ID does not exist" containerID="6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"
Oct 30 21:16:56.993941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:56.993888    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f"} err="failed to get container status \"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f\": rpc error: code = NotFound desc = could not find container \"6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f\": container with ID starting with 6b75251e1feb13096d92e426222c276398856df7ef51c3b339b4fea6f98c416f not found: ID does not exist"
Oct 30 21:16:57.002794 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:57.002769    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 21:16:57.007451 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:57.007420    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5db654b954-64xd4"]
Oct 30 21:16:58.369829 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.369800    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" path="/var/lib/kubelet/pods/5990cf8b-b58b-4096-a31a-bee92a8f29a9/volumes"
Oct 30 21:16:58.515337 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.515262    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:16:58.517488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.516774    5115 cpu_manager.go:414] "containerMap: removing container" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerName="maas-api"
Oct 30 21:16:58.517488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.516798    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerName="maas-api"
Oct 30 21:16:58.517488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.516941    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="5990cf8b-b58b-4096-a31a-bee92a8f29a9" containerName="maas-api"
Oct 30 21:16:58.521946 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.521925    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.537276 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.537248    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c3e6d92c-serving-cert\""
Oct 30 21:16:58.545195 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.545151    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:16:58.604541 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.604498    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.604726 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.604557    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.604795 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.604754    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.604929 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.604905    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwlj9\" (UniqueName: \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.706043 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.705957    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.706043 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.705995    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.706043 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.706026    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.706334 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.706060    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwlj9\" (UniqueName: \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.706760 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.706733    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.708667 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.708642    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.708766 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.708684    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.717219 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.717190    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwlj9\" (UniqueName: \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\") pod \"maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:58.855495 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:58.855466    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:16:59.139068 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:16:59.139041    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:16:59.141766 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:16:59.141720    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef1bce6_893d_4f27_8d70_ff8148611ce0.slice/crio-1a24773608a67b2d53c15f849882188db17b65fd5dd81dd99da748b2accc0d53 WatchSource:0}: Error finding container 1a24773608a67b2d53c15f849882188db17b65fd5dd81dd99da748b2accc0d53: Status 404 returned error can't find the container with id 1a24773608a67b2d53c15f849882188db17b65fd5dd81dd99da748b2accc0d53
Oct 30 21:17:00.001985 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:00.001895    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" event={"ID":"2ef1bce6-893d-4f27-8d70-ff8148611ce0","Type":"ContainerStarted","Data":"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"}
Oct 30 21:17:00.001985 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:00.001956    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" event={"ID":"2ef1bce6-893d-4f27-8d70-ff8148611ce0","Type":"ContainerStarted","Data":"1a24773608a67b2d53c15f849882188db17b65fd5dd81dd99da748b2accc0d53"}
Oct 30 21:17:00.002499 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:00.002078    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:17:00.022575 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:00.022508    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" podStartSLOduration=1.5864599780000002 podStartE2EDuration="2.022494211s" totalImagesPullingTime="436.034233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:00.019870826 +0000 UTC m=+2281.823765604" watchObservedRunningTime="2026-10-30 21:17:00.022494211 +0000 UTC m=+2281.826388974"
Oct 30 21:17:06.016131 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:06.016099    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:17:06.279443 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:17:06.279360    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:17:24.320873 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.320784    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:17:24.321351 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.321031    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" podUID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" containerName="maas-api" containerID="cri-o://1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579" gracePeriod=30
Oct 30 21:17:24.602415 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.602391    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:17:24.670355 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.670322    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\") pod \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") "
Oct 30 21:17:24.670545 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.670405    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\") pod \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") "
Oct 30 21:17:24.670607 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.670574    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\") pod \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") "
Oct 30 21:17:24.670701 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.670681    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\" (UniqueName: \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\") pod \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\" (UID: \"2ef1bce6-893d-4f27-8d70-ff8148611ce0\") "
Oct 30 21:17:24.670770 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.670723    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca" pod "2ef1bce6-893d-4f27-8d70-ff8148611ce0" (UID: "2ef1bce6-893d-4f27-8d70-ff8148611ce0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:24.671109 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.671083    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef1bce6-893d-4f27-8d70-ff8148611ce0-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:17:24.672688 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.672663    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls" pod "2ef1bce6-893d-4f27-8d70-ff8148611ce0" (UID: "2ef1bce6-893d-4f27-8d70-ff8148611ce0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:24.673097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.673075    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs" pod "2ef1bce6-893d-4f27-8d70-ff8148611ce0" (UID: "2ef1bce6-893d-4f27-8d70-ff8148611ce0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:24.673163 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.673128    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9" pod "2ef1bce6-893d-4f27-8d70-ff8148611ce0" (UID: "2ef1bce6-893d-4f27-8d70-ff8148611ce0"). InnerVolumeSpecName "kube-api-access-bwlj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:24.771878 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.771842    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:17:24.771878 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.771879    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwlj9\" (UniqueName: \"kubernetes.io/projected/2ef1bce6-893d-4f27-8d70-ff8148611ce0-kube-api-access-bwlj9\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:17:24.772108 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:24.771894    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef1bce6-893d-4f27-8d70-ff8148611ce0-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.164930 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.164893    5115 generic.go:356] "Generic (PLEG): container finished" podID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" containerID="1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579" exitCode=0
Oct 30 21:17:25.165147 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.164951    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"
Oct 30 21:17:25.165147 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.164982    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" event={"ID":"2ef1bce6-893d-4f27-8d70-ff8148611ce0","Type":"ContainerDied","Data":"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"}
Oct 30 21:17:25.165147 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.165033    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh" event={"ID":"2ef1bce6-893d-4f27-8d70-ff8148611ce0","Type":"ContainerDied","Data":"1a24773608a67b2d53c15f849882188db17b65fd5dd81dd99da748b2accc0d53"}
Oct 30 21:17:25.165147 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.165045    5115 scope.go:122] "RemoveContainer" containerID="1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"
Oct 30 21:17:25.176012 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.175995    5115 scope.go:122] "RemoveContainer" containerID="1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"
Oct 30 21:17:25.176248 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:17:25.176228    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579\": container with ID starting with 1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579 not found: ID does not exist" containerID="1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"
Oct 30 21:17:25.176292 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.176256    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579"} err="failed to get container status \"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579\": rpc error: code = NotFound desc = could not find container \"1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579\": container with ID starting with 1d9b1cbdcd2a2d67493147db252f3bf0cbad1898b812256e7e42ae25b2838579 not found: ID does not exist"
Oct 30 21:17:25.188419 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.188395    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:17:25.191040 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:25.191019    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c3e6d92c-5856b7bb5b-s77jh"]
Oct 30 21:17:26.368403 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:26.368365    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" path="/var/lib/kubelet/pods/2ef1bce6-893d-4f27-8d70-ff8148611ce0/volumes"
Oct 30 21:17:36.278930 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:17:36.278893    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:17:46.533880 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.533841    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:17:46.536625 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.534606    5115 cpu_manager.go:414] "containerMap: removing container" podUID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" containerName="maas-api"
Oct 30 21:17:46.536625 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.534624    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" containerName="maas-api"
Oct 30 21:17:46.536625 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.534748    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ef1bce6-893d-4f27-8d70-ff8148611ce0" containerName="maas-api"
Oct 30 21:17:46.538597 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.538575    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.546115 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.546087    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-dd6b21-serving-cert\""
Oct 30 21:17:46.558514 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.558476    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:17:46.704083 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.704046    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.704267 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.704113    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lprw9\" (UniqueName: \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.704267 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.704203    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.704439 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.704272    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.805941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.805853    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.805941 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.805928    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.806180 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.805984    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.806180 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.806035    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lprw9\" (UniqueName: \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.806859 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.806822    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.808439 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.808411    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.808606 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.808583    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.817314 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.817286    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lprw9\" (UniqueName: \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\") pod \"maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:46.860997 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:46.860958    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:47.175054 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:47.174960    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:17:47.177642 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:17:47.177601    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a9c1e8_94ae_4da3_b871_844e065df068.slice/crio-eda1ad02b1a34a23a6da3badd593223f670a4d3000bd9f3097e470efa02300a9 WatchSource:0}: Error finding container eda1ad02b1a34a23a6da3badd593223f670a4d3000bd9f3097e470efa02300a9: Status 404 returned error can't find the container with id eda1ad02b1a34a23a6da3badd593223f670a4d3000bd9f3097e470efa02300a9
Oct 30 21:17:47.300018 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:47.299974    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" event={"ID":"07a9c1e8-94ae-4da3-b871-844e065df068","Type":"ContainerStarted","Data":"eda1ad02b1a34a23a6da3badd593223f670a4d3000bd9f3097e470efa02300a9"}
Oct 30 21:17:48.308237 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:48.308201    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" event={"ID":"07a9c1e8-94ae-4da3-b871-844e065df068","Type":"ContainerStarted","Data":"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"}
Oct 30 21:17:48.308753 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:48.308330    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:17:48.327629 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:48.327579    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" podStartSLOduration=1.87501619 podStartE2EDuration="2.327565931s" totalImagesPullingTime="452.549741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:48.325430083 +0000 UTC m=+2330.129324857" watchObservedRunningTime="2026-10-30 21:17:48.327565931 +0000 UTC m=+2330.131460722"
Oct 30 21:17:54.320139 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:17:54.320104    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:18:06.280762 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:18:06.280723    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:18:36.280390 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:18:36.280349    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:18:59.300425 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:18:59.300389    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:18:59.432494 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:18:59.432466    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:19:06.281111 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:19:06.281069    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:19:30.607046 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.607005    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:19:30.607735 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.607319    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" podUID="07a9c1e8-94ae-4da3-b871-844e065df068" containerName="maas-api" containerID="cri-o://3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17" gracePeriod=30
Oct 30 21:19:30.901284 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.901252    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:19:30.967106 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.967072    5115 generic.go:356] "Generic (PLEG): container finished" podID="07a9c1e8-94ae-4da3-b871-844e065df068" containerID="3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17" exitCode=0
Oct 30 21:19:30.967264 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.967138    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"
Oct 30 21:19:30.967264 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.967160    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" event={"ID":"07a9c1e8-94ae-4da3-b871-844e065df068","Type":"ContainerDied","Data":"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"}
Oct 30 21:19:30.967264 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.967224    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m" event={"ID":"07a9c1e8-94ae-4da3-b871-844e065df068","Type":"ContainerDied","Data":"eda1ad02b1a34a23a6da3badd593223f670a4d3000bd9f3097e470efa02300a9"}
Oct 30 21:19:30.967264 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.967258    5115 scope.go:122] "RemoveContainer" containerID="3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"
Oct 30 21:19:30.977484 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.977466    5115 scope.go:122] "RemoveContainer" containerID="3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"
Oct 30 21:19:30.977797 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:19:30.977768    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17\": container with ID starting with 3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17 not found: ID does not exist" containerID="3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"
Oct 30 21:19:30.977887 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.977801    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17"} err="failed to get container status \"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17\": rpc error: code = NotFound desc = could not find container \"3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17\": container with ID starting with 3f87ccc6d1d8c7321532ecdf79fbf6b7b139720d910ccb0fa55d2d8906e01b17 not found: ID does not exist"
Oct 30 21:19:30.995328 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.995301    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\") pod \"07a9c1e8-94ae-4da3-b871-844e065df068\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") "
Oct 30 21:19:30.995426 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.995373    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\") pod \"07a9c1e8-94ae-4da3-b871-844e065df068\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") "
Oct 30 21:19:30.995467 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.995458    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\" (UniqueName: \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\") pod \"07a9c1e8-94ae-4da3-b871-844e065df068\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") "
Oct 30 21:19:30.995510 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.995477    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\") pod \"07a9c1e8-94ae-4da3-b871-844e065df068\" (UID: \"07a9c1e8-94ae-4da3-b871-844e065df068\") "
Oct 30 21:19:30.995918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.995892    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca" pod "07a9c1e8-94ae-4da3-b871-844e065df068" (UID: "07a9c1e8-94ae-4da3-b871-844e065df068"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:30.997768 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.997744    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls" pod "07a9c1e8-94ae-4da3-b871-844e065df068" (UID: "07a9c1e8-94ae-4da3-b871-844e065df068"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:30.998023 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.998007    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs" pod "07a9c1e8-94ae-4da3-b871-844e065df068" (UID: "07a9c1e8-94ae-4da3-b871-844e065df068"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:30.998109 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:30.998083    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9" pod "07a9c1e8-94ae-4da3-b871-844e065df068" (UID: "07a9c1e8-94ae-4da3-b871-844e065df068"). InnerVolumeSpecName "kube-api-access-lprw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:31.097312 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.097281    5115 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-maas-api-tls\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:31.097312 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.097308    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lprw9\" (UniqueName: \"kubernetes.io/projected/07a9c1e8-94ae-4da3-b871-844e065df068-kube-api-access-lprw9\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:31.097312 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.097320    5115 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a9c1e8-94ae-4da3-b871-844e065df068-openshift-service-ca\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:31.097554 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.097328    5115 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07a9c1e8-94ae-4da3-b871-844e065df068-metrics-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:31.291018 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.290972    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:19:31.298819 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:31.298791    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-dd6b21-7494495c6f-r644m"]
Oct 30 21:19:32.368471 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:19:32.368434    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07a9c1e8-94ae-4da3-b871-844e065df068" path="/var/lib/kubelet/pods/07a9c1e8-94ae-4da3-b871-844e065df068/volumes"
Oct 30 21:19:36.279589 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:19:36.279553    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:20:06.279564 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:20:06.279500    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:20:36.280413 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:20:36.280317    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:20:47.934491 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:47.934449    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5d4f8585d4-9vb62_ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4/manager/0.log"
Oct 30 21:20:48.133187 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:48.133151    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-c7jm5_c740d2a1-d9b4-478b-8245-9e5e8b19c3f6/manager/0.log"
Oct 30 21:20:48.315618 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:48.315589    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9zt2k_22370cb8-0a30-4b11-aec8-332e990bfc4d/manager/0.log"
Oct 30 21:20:48.810449 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:48.810415    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:20:49.038687 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:49.038663    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-r7zmp_359e3225-1a52-4746-a68a-27b68aa1c983/server/0.log"
Oct 30 21:20:49.229157 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:49.229083    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-7kxpw_b9c31d4c-e54e-4e92-b12d-f8d887705066/manager/0.log"
Oct 30 21:20:49.447191 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:49.447159    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-bq4f9_f55318a5-e2e8-43f4-a47c-daa24f7c41ab/proxy/0.log"
Oct 30 21:20:50.382666 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:50.382637    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f84c677c8-kznhv_5ed4e15f-0134-4530-bde5-f0ce441a13a5/maas-api/0.log"
Oct 30 21:20:51.644828 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:51.644800    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-l4b28_33b02e5f-4f87-4c2b-894c-c16da4a3a505/postgres/0.log"
Oct 30 21:20:53.407873 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:53.407829    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-86mtf_65baaf66-0a6b-4a37-825c-5ff6459c47e7/manager/0.log"
Oct 30 21:20:53.980287 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:53.980255    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-dzntl_d22ada80-1656-462c-8fcc-b295950c93b2/manager/0.log"
Oct 30 21:20:54.391891 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:54.391858    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-646d5_e2c1819d-d38b-4d86-bb9c-0e8c457ef993/manager/0.log"
Oct 30 21:20:55.172179 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:55.172148    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr_b7a6d2e9-b069-4983-88bf-1cd4262e5048/istio-proxy/0.log"
Oct 30 21:20:55.890959 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:55.890930    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-7cwww_b06ebb90-da25-4937-868a-bc58f3b6ee05/istio-proxy/0.log"
Oct 30 21:20:56.439930 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:56.439897    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-dlnwn_ce13999b-0475-4547-82bd-8a29bd61ec66/istio-proxy/1.log"
Oct 30 21:20:56.630400 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:56.630365    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-k29kh_b6886a61-73e6-4814-adbf-04584f946ec4/istio-proxy/0.log"
Oct 30 21:20:57.927251 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:57.927213    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-25lwm_662e9cb2-69fc-45d5-8b0f-746b87c45e62/payload-pre-processing/0.log"
Oct 30 21:20:58.105737 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:58.105707    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:20:58.288109 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:58.288067    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6987c8f769-xrp2s_79fa788b-5742-40c8-9fa5-7e2cc2cd2005/router/0.log"
Oct 30 21:20:58.746576 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:58.746481    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-dlnwn_ce13999b-0475-4547-82bd-8a29bd61ec66/istio-proxy/0.log"
Oct 30 21:20:59.300274 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:59.300241    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r_6954dc2e-9cb9-4330-9281-bc63ce255bb9/main/0.log"
Oct 30 21:20:59.663092 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:20:59.663009    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-jmqjw_42072638-49f4-4d89-83db-694b8d828a1a/main/0.log"
Oct 30 21:21:00.019422 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:00.019391    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4_6529e2bd-2ff0-473d-8bee-89ca41036578/main/0.log"
Oct 30 21:21:00.201682 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:00.201647    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-6mk6g_4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1/main/0.log"
Oct 30 21:21:00.562356 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:00.562327    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp_c7ebf960-5308-4e3b-99ff-488bc3311a13/main/0.log"
Oct 30 21:21:06.278247 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:21:06.278208    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:21:10.586356 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:10.586311    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5d4f8585d4-9vb62_ce9e825f-bfab-4a9e-a191-cc3fbb4c32f4/manager/0.log"
Oct 30 21:21:10.782582 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:10.782541    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-c7jm5_c740d2a1-d9b4-478b-8245-9e5e8b19c3f6/manager/0.log"
Oct 30 21:21:10.973089 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:10.973007    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9zt2k_22370cb8-0a30-4b11-aec8-332e990bfc4d/manager/0.log"
Oct 30 21:21:11.429001 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:11.428967    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:21:11.641312 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:11.641284    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-r7zmp_359e3225-1a52-4746-a68a-27b68aa1c983/server/0.log"
Oct 30 21:21:11.820950 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:11.820921    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-7kxpw_b9c31d4c-e54e-4e92-b12d-f8d887705066/manager/0.log"
Oct 30 21:21:12.035205 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:12.035176    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-bq4f9_f55318a5-e2e8-43f4-a47c-daa24f7c41ab/proxy/0.log"
Oct 30 21:21:12.743814 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:12.743778    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f84c677c8-kznhv_5ed4e15f-0134-4530-bde5-f0ce441a13a5/maas-api/0.log"
Oct 30 21:21:23.649389 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:23.649338    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-l4b28_33b02e5f-4f87-4c2b-894c-c16da4a3a505/postgres/0.log"
Oct 30 21:21:25.036780 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:25.036747    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-86mtf_65baaf66-0a6b-4a37-825c-5ff6459c47e7/manager/0.log"
Oct 30 21:21:25.611639 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:25.611605    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-dzntl_d22ada80-1656-462c-8fcc-b295950c93b2/manager/0.log"
Oct 30 21:21:25.996977 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:25.996890    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-646d5_e2c1819d-d38b-4d86-bb9c-0e8c457ef993/manager/0.log"
Oct 30 21:21:26.573247 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:26.573213    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6c85d847d5r9bjr_b7a6d2e9-b069-4983-88bf-1cd4262e5048/istio-proxy/0.log"
Oct 30 21:21:27.334420 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:27.334386    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-7cwww_b06ebb90-da25-4937-868a-bc58f3b6ee05/istio-proxy/0.log"
Oct 30 21:21:27.893507 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:27.893480    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-dlnwn_ce13999b-0475-4547-82bd-8a29bd61ec66/istio-proxy/1.log"
Oct 30 21:21:28.079791 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:28.079762    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6db586dd6c-k29kh_b6886a61-73e6-4814-adbf-04584f946ec4/istio-proxy/0.log"
Oct 30 21:21:29.366675 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:29.366637    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-25lwm_662e9cb2-69fc-45d5-8b0f-746b87c45e62/payload-pre-processing/0.log"
Oct 30 21:21:29.539831 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:29.539801    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:21:29.733421 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:29.733342    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6987c8f769-xrp2s_79fa788b-5742-40c8-9fa5-7e2cc2cd2005/router/0.log"
Oct 30 21:21:30.245356 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:30.245329    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-c2r6r_6954dc2e-9cb9-4330-9281-bc63ce255bb9/main/0.log"
Oct 30 21:21:30.611816 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:30.611785    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-jmqjw_42072638-49f4-4d89-83db-694b8d828a1a/main/0.log"
Oct 30 21:21:30.983051 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:30.982962    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8l2fr4_6529e2bd-2ff0-473d-8bee-89ca41036578/main/0.log"
Oct 30 21:21:31.157881 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:31.157854    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-6mk6g_4a4e4ff8-8e01-4476-ad23-d86ae3a40ac1/main/0.log"
Oct 30 21:21:31.506167 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:21:31.506139    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-ktggp_c7ebf960-5308-4e3b-99ff-488bc3311a13/main/0.log"
Oct 30 21:21:36.278846 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:21:36.278815    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:22:06.279439 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:22:06.279379    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:22:36.279403 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:22:36.279359    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:23:00.335742 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:00.335698    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:23:00.606174 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:00.606086    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:23:01.342586 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:01.342536    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:23:01.513400 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:01.513375    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:23:06.280797 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:23:06.280757    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:23:36.278422 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:23:36.278335    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:23:59.343277 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:59.343247    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:23:59.473302 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:23:59.473274    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-g8jj6_69b633d2-97d9-4a07-9506-45658f48ee49/console-operator/3.log"
Oct 30 21:24:06.279984 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:24:06.279947    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:24:36.280230 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:24:36.280196    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:25:06.279223 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:25:06.279185    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:25:09.697097 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:09.697065    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:25:09.974176 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:09.974083    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54df5bbf78-sjqgq_b6e32908-0f79-447c-bd5a-3619a889d392/manager/0.log"
Oct 30 21:25:10.704960 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:10.704933    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:25:10.892598 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:10.892549    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-gl64r_b1f8a0c7-d37e-4cd1-a773-a016bda1b7d8/payload-processing/0.log"
Oct 30 21:25:14.671812 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:14.671759    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qztc_50d8f3d8-875f-413d-996a-a4a68910b7fd/global-pull-secret-syncer/0.log"
Oct 30 21:25:14.833011 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:14.832980    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-2hkcr_78825b89-4bdd-4e7c-b145-e3f5b3eab767/connection-checker/0.log"
Oct 30 21:25:14.868127 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:14.868103    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-ghwzz_22d96d38-8111-4e17-9bcf-14205835c57c/connection-checker/0.log"
Oct 30 21:25:14.901606 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:14.901583    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-v92r5_05a4dcfe-ec1d-46d3-a3fd-dc1607b86e99/connection-checker/0.log"
Oct 30 21:25:15.017415 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:15.017391    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k6rvl_12625149-ab99-482a-8617-4ef8fe1b541a/konnectivity-agent/0.log"
Oct 30 21:25:15.129500 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:15.129462    5115 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-104.us-east-2.compute.internal_dab6cd5a3212618f353a61406cc55b55/haproxy/0.log"
Oct 30 21:25:36.280348 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:25:36.280307    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:25:53.847690 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:53.847648    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 21:25:53.848297 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:53.847876    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy" containerID="cri-o://7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e" gracePeriod=30
Oct 30 21:25:53.851200 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:53.851175    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 21:25:53.851426 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:53.851393    5115 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy" containerID="cri-o://d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0" gracePeriod=30
Oct 30 21:25:59.113847 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.113814    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 21:25:59.143387 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.143349    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 21:25:59.203102 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203065    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203112    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203145    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203188    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203275 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203231    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203284    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203324    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203363    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203394    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203411    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203423    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.203498 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203425    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203506    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203547    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203556    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203591    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203639    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203665    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203700    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203735    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203764    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\") pod \"b6886a61-73e6-4814-adbf-04584f946ec4\" (UID: \"b6886a61-73e6-4814-adbf-04584f946ec4\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203772    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203831    5115 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\") pod \"b06ebb90-da25-4937-868a-bc58f3b6ee05\" (UID: \"b06ebb90-da25-4937-868a-bc58f3b6ee05\") "
Oct 30 21:25:59.203918 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203843    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.203958    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204076    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204299    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204321    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204335    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204350    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204364    5115 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-data\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204377    5115 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-certs\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204424    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ebb90-da25-4937-868a-bc58f3b6ee05-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204439    5115 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-credential-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.204550 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204518    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.205166 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.204609    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:59.206209 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.206168    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:25:59.206604 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.206416    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.206604 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.206457    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "kube-api-access-g8pwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:59.206604 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.206573    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "kube-api-access-dvnnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:59.207745 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.207010    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:59.207869 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.207750    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:59.207938 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.207914    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy" pod "b6886a61-73e6-4814-adbf-04584f946ec4" (UID: "b6886a61-73e6-4814-adbf-04584f946ec4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:59.208332 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.208313    5115 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo" pod "b06ebb90-da25-4937-868a-bc58f3b6ee05" (UID: "b06ebb90-da25-4937-868a-bc58f3b6ee05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:25:59.305071 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305035    5115 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-workload-socket\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305071 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305067    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8pwq\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-kube-api-access-g8pwq\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305082    5115 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6886a61-73e6-4814-adbf-04584f946ec4-istiod-ca-cert\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305095    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6886a61-73e6-4814-adbf-04584f946ec4-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305104    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305113    5115 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-podinfo\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305123    5115 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-token\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305131    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6886a61-73e6-4814-adbf-04584f946ec4-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305142    5115 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ebb90-da25-4937-868a-bc58f3b6ee05-istio-envoy\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.305278 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.305151    5115 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvnnp\" (UniqueName: \"kubernetes.io/projected/b6886a61-73e6-4814-adbf-04584f946ec4-kube-api-access-dvnnp\") on node \"ip-10-0-135-104.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:25:59.346732 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.346698    5115 generic.go:356] "Generic (PLEG): container finished" podID="b6886a61-73e6-4814-adbf-04584f946ec4" containerID="d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0" exitCode=0
Oct 30 21:25:59.346909 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.346746    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"
Oct 30 21:25:59.346909 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.346782    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" event={"ID":"b6886a61-73e6-4814-adbf-04584f946ec4","Type":"ContainerDied","Data":"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"}
Oct 30 21:25:59.346909 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.346843    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh" event={"ID":"b6886a61-73e6-4814-adbf-04584f946ec4","Type":"ContainerDied","Data":"cae446276e9f89991aba2d83c275ea41d71b448598a28aa3f5be879ed1d2c361"}
Oct 30 21:25:59.346909 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.346868    5115 scope.go:122] "RemoveContainer" containerID="d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"
Oct 30 21:25:59.348313 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.348289    5115 generic.go:356] "Generic (PLEG): container finished" podID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerID="7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e" exitCode=0
Oct 30 21:25:59.348419 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.348329    5115 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"
Oct 30 21:25:59.348419 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.348350    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" event={"ID":"b06ebb90-da25-4937-868a-bc58f3b6ee05","Type":"ContainerDied","Data":"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"}
Oct 30 21:25:59.348419 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.348389    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww" event={"ID":"b06ebb90-da25-4937-868a-bc58f3b6ee05","Type":"ContainerDied","Data":"a769a92da846d11d898a053518273792b32b365d2a51a518ef1de77ac76ad405"}
Oct 30 21:25:59.357270 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.357246    5115 scope.go:122] "RemoveContainer" containerID="d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"
Oct 30 21:25:59.357635 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:25:59.357615    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0\": container with ID starting with d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0 not found: ID does not exist" containerID="d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"
Oct 30 21:25:59.357720 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.357642    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0"} err="failed to get container status \"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0\": rpc error: code = NotFound desc = could not find container \"d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0\": container with ID starting with d7c886255f4b6a6d9656df13f4f0c2fc10c2734940fe23c3711389c8ca7f2bd0 not found: ID does not exist"
Oct 30 21:25:59.357720 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.357657    5115 scope.go:122] "RemoveContainer" containerID="7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"
Oct 30 21:25:59.368066 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.368039    5115 scope.go:122] "RemoveContainer" containerID="7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"
Oct 30 21:25:59.368403 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:25:59.368382    5115 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e\": container with ID starting with 7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e not found: ID does not exist" containerID="7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"
Oct 30 21:25:59.368503 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.368423    5115 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e"} err="failed to get container status \"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e\": rpc error: code = NotFound desc = could not find container \"7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e\": container with ID starting with 7c8348e9f3496ba8e2e6868a618d8070d1d4a282eb407478453e555048a6fc3e not found: ID does not exist"
Oct 30 21:25:59.369758 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.369738    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 21:25:59.375056 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.375021    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-k29kh"]
Oct 30 21:25:59.385189 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.385131    5115 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 21:25:59.387842 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:25:59.387820    5115 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6db586dd6c-7cwww"]
Oct 30 21:26:00.367446 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:00.367402    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" path="/var/lib/kubelet/pods/b06ebb90-da25-4937-868a-bc58f3b6ee05/volumes"
Oct 30 21:26:00.368074 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:00.368053    5115 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" path="/var/lib/kubelet/pods/b6886a61-73e6-4814-adbf-04584f946ec4/volumes"
Oct 30 21:26:06.280400 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:26:06.280349    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"
Oct 30 21:26:11.074655 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.074564    5115 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"]
Oct 30 21:26:11.075252 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075231    5115 cpu_manager.go:414] "containerMap: removing container" podUID="07a9c1e8-94ae-4da3-b871-844e065df068" containerName="maas-api"
Oct 30 21:26:11.075353 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075254    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07a9c1e8-94ae-4da3-b871-844e065df068" containerName="maas-api"
Oct 30 21:26:11.075353 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075321    5115 cpu_manager.go:414] "containerMap: removing container" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy"
Oct 30 21:26:11.075353 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075329    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy"
Oct 30 21:26:11.075518 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075353    5115 cpu_manager.go:414] "containerMap: removing container" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy"
Oct 30 21:26:11.075518 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075363    5115 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy"
Oct 30 21:26:11.075518 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075495    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6886a61-73e6-4814-adbf-04584f946ec4" containerName="istio-proxy"
Oct 30 21:26:11.075518 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075509    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="b06ebb90-da25-4937-868a-bc58f3b6ee05" containerName="istio-proxy"
Oct 30 21:26:11.075742 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.075540    5115 memory_manager.go:365] "RemoveStaleState removing state" podUID="07a9c1e8-94ae-4da3-b871-844e065df068" containerName="maas-api"
Oct 30 21:26:11.080810 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.080786    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.085482 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.085446    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hgxj\"/\"openshift-service-ca.crt\""
Oct 30 21:26:11.085667 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.085536    5115 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hgxj\"/\"kube-root-ca.crt\""
Oct 30 21:26:11.086661 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.086635    5115 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hgxj\"/\"default-dockercfg-z7szz\""
Oct 30 21:26:11.088506 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.088477    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"]
Oct 30 21:26:11.221814 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.221771    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-podres\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.222008 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.221876    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-sys\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.222008 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.221958    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-proc\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.222088 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.222028    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql487\" (UniqueName: \"kubernetes.io/projected/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-kube-api-access-ql487\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.222127 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.222089    5115 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-lib-modules\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323650 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323607    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-proc\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323840 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323660    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql487\" (UniqueName: \"kubernetes.io/projected/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-kube-api-access-ql487\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323840 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323714    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-lib-modules\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323840 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323739    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-podres\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323840 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323744    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-proc\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.323840 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323837    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-lib-modules\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.324026 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323836    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-podres\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.324026 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323863    5115 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-sys\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.324026 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.323897    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-sys\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.335076 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.334999    5115 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql487\" (UniqueName: \"kubernetes.io/projected/5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1-kube-api-access-ql487\") pod \"perf-node-gather-daemonset-jtsw7\" (UID: \"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1\") " pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.394407 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.394357    5115 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:11.674171 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:11.674077    5115 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"]
Oct 30 21:26:11.681162 ip-10-0-135-104 kubenswrapper[5115]: W1030 21:26:11.681134    5115 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5de0f9b0_acf0_4fd8_b82e_d2eaefc6ecd1.slice/crio-90ea3b2c222191f24be59be56fd9e7218bd7bdaab46cf6c115caa3f7690a836e WatchSource:0}: Error finding container 90ea3b2c222191f24be59be56fd9e7218bd7bdaab46cf6c115caa3f7690a836e: Status 404 returned error can't find the container with id 90ea3b2c222191f24be59be56fd9e7218bd7bdaab46cf6c115caa3f7690a836e
Oct 30 21:26:12.425053 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:12.425020    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7" event={"ID":"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1","Type":"ContainerStarted","Data":"bbdc359c8895e83941694d5648b830bcfb6b954072502ea3ed258f5e04488dea"}
Oct 30 21:26:12.425488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:12.425064    5115 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7" event={"ID":"5de0f9b0-acf0-4fd8-b82e-d2eaefc6ecd1","Type":"ContainerStarted","Data":"90ea3b2c222191f24be59be56fd9e7218bd7bdaab46cf6c115caa3f7690a836e"}
Oct 30 21:26:12.425488 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:12.425172    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:12.442338 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:12.442292    5115 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7" podStartSLOduration=1.442279669 podStartE2EDuration="1.442279669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:12.441129163 +0000 UTC m=+2834.245023918" watchObservedRunningTime="2026-10-30 21:26:12.442279669 +0000 UTC m=+2834.246174425"
Oct 30 21:26:18.441279 ip-10-0-135-104 kubenswrapper[5115]: I1030 21:26:18.441252    5115 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hgxj/perf-node-gather-daemonset-jtsw7"
Oct 30 21:26:36.279822 ip-10-0-135-104 kubenswrapper[5115]: E1030 21:26:36.279784    5115 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9xhnp" containerName="extractor"