Oct 30 02:52:48.408740 ip-10-0-136-202 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 02:52:48.408750 ip-10-0-136-202 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 02:52:48.408757 ip-10-0-136-202 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 02:52:48.408973 ip-10-0-136-202 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 02:52:58.522712 ip-10-0-136-202 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 02:52:58.522729 ip-10-0-136-202 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e5e39d82522343ac917f7debe6760832 --
Oct 30 02:54:48.817240 ip-10-0-136-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:54:49.220330 ip-10-0-136-202 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:54:49.220330 ip-10-0-136-202 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:54:49.220330 ip-10-0-136-202 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:54:49.220330 ip-10-0-136-202 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:54:49.223435 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223369    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.223435 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223435    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223440    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223443    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223447    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223450    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223453    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223455    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223458    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223460    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223463    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223465    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223470    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223473    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223476    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223480    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223483    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223485    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223488    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223491    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.223497 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223494    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223496    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223499    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223502    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223505    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223508    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223514    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223517    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223520    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223522    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223525    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223527    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223530    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223533    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223535    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223538    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223541    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223543    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223546    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223548    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.223929 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223551    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223553    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223556    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223558    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223560    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223563    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223566    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223568    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223570    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223573    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223575    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223578    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223580    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223584    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223588    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223590    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223593    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223596    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223598    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.224406 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223601    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223603    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223606    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223608    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223611    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223614    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223616    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223619    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223622    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223624    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223628    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223632    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223635    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223638    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223641    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223644    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223647    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223649    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223652    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.224851 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223655    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223657    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223660    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223662    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223665    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223668    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223670    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223674    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223677    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223679    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223684    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223687    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223689    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223692    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223694    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223697    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223699    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223702    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223704    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.225400 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223707    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223709    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223712    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223715    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223717    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223720    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223722    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223725    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.223727    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224494    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224501    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224505    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224508    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224511    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224514    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224517    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224520    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224523    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224525    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224528    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.225879 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224531    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224534    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224536    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224539    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224542    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224544    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224547    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224549    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224554    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224558    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224560    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224563    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224566    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224569    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224571    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224574    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224576    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224579    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224581    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.226373 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224584    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224586    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224589    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224591    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224594    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224596    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224599    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224602    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224604    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224607    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224609    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224612    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224616    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224619    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224622    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224625    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224627    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224630    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224632    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224635    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.226824 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224638    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224640    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224642    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224645    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224647    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224650    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224652    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224655    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224657    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224660    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224663    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224665    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224668    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224670    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224673    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224675    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224678    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224680    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224683    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.227306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224686    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224688    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224691    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224693    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224695    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224698    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224701    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224704    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224707    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224709    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224713    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224717    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224721    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224724    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224726    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224729    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224731    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224735    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224738    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224740    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.227753 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224743    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224745    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224748    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224750    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224753    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224755    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224758    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224760    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224763    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224765    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224768    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224770    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224772    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224775    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224778    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224781    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.224783    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225332    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225339    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.228275 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225342    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225345    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225348    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225350    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225354    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225356    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225359    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225362    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225364    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225367    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225369    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225372    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225375    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225377    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225380    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225383    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225385    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225388    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225390    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.228728 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225392    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225395    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225398    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225400    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225403    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225405    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225408    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225411    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225414    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225417    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225419    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225426    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225428    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225431    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225434    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225436    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225439    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225442    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225446    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.229205 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225450    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225453    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225456    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225458    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225461    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225464    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225466    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225469    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225472    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225475    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225477    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225480    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225482    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225484    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225487    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225489    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225492    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225494    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225497    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.229671 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225499    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225502    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225506    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225509    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225512    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225515    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225519    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225521    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225524    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225526    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225529    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225531    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225534    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225537    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225539    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225541    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225544    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225546    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225549    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225551    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.230135 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225554    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225556    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225559    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225561    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225563    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225566    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225568    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225571    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225573    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225576    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225578    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225581    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225583    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225586    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225589    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225593    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225597    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225601    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225603    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.230612 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225606    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225609    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225611    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225614    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225616    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225619    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225621    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.225624    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226529    2584 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226543    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226549    2584 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226554    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226558    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226562    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226566    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226571    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226574    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226577    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226580    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226583    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226586    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226589    2584 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:54:49.231070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226592    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226595    2584 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226598    2584 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226601    2584 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226605    2584 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226608    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226611    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226615    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226619    2584 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226623    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226626    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226629    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226632    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226635    2584 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226638    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226641    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226644    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226647    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226651    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226654    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226657    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226659    2584 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226662    2584 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226665    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226670    2584 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:54:49.231579 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226673    2584 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226675    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226678    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226681    2584 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226685    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226688    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226691    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226694    2584 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226697    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226700    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226703    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226705    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226708    2584 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226711    2584 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226714    2584 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226719    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226722    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226725    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226729    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226732    2584 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226736    2584 flags.go:64] FLAG: --help="false"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226738    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226742    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226760    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:54:49.232235 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226764    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226768    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226772    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226775    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226778    2584 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226781    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226784    2584 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226787    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226790    2584 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226793    2584 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226796    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226799    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226802    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226805    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226808    2584 flags.go:64] FLAG: --lock-file=""
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226811    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226814    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226816    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226821    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226824    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226828    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226830    2584 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226833    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226837    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:54:49.232860 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226840    2584 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226843    2584 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226848    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226851    2584 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226854    2584 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226857    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226860    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226863    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226866    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226868    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226871    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226874    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226881    2584 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226884    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226887    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226890    2584 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226892    2584 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226895    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226898    2584 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226901    2584 flags.go:64] FLAG: --port="10250"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226904    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226907    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aed9899c808d1065"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226910    2584 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226913    2584 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226916    2584 flags.go:64] FLAG: --register-node="true"
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226919    2584 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:54:49.233451 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226923    2584 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226925    2584 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226928    2584 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226931    2584 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226935    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226938    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226941    2584 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226944    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226947    2584 flags.go:64] FLAG: --runonce="false"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226950    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226955    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226958    2584 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226961    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226963    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226967    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226981    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226984    2584 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226987    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226989    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226993    2584 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226995    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.226999    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227001    2584 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227004    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227009    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:54:49.234072 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227012    2584 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227015    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227020    2584 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227023    2584 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227025    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227028    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227031    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227034    2584 flags.go:64] FLAG: --v="2"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227039    2584 flags.go:64] FLAG: --version="false"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227043    2584 flags.go:64] FLAG: --vmodule=""
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227047    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227050    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227190    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227195    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227198    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227201    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227204    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227208    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227211    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227213    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227216    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227219    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.234645 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227221    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227224    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227227    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227231    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227234    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227238    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227240    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227243    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227246    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227248    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227251    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227253    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227257    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227260    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227263    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227265    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227268    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227271    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227273    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.235168 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227276    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227279    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227281    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227284    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227286    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227289    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227291    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227295    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227298    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227301    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227304    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227306    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227309    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227312    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227314    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227317    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227319    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227322    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227324    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227327    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.235657 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227330    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227333    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227335    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227337    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227340    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227344    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227346    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227349    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227351    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227354    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227356    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227359    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227361    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227364    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227367    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227369    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227372    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227374    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227377    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.236493 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227379    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227384    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227388    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227391    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227394    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227397    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227400    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227403    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227405    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227408    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227410    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227413    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227415    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227418    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227420    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227423    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227425    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227428    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227431    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.236963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227434    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227437    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227439    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227442    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227444    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227447    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227450    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227452    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227455    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227458    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227460    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227463    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227465    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227468    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227472    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227474    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227477    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227480    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.237461 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227482    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.227508    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227541    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227545    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227548    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227551    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227554    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227556    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227559    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227561    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227564    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227566    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227569    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227572    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227576    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227579    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.237885 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227581    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227584    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227586    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227589    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227591    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227594    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227597    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227599    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227602    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227604    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227607    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227609    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227613    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227617    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227621    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227625    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227627    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227630    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227633    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.238286 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227635    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227638    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227641    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227643    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227645    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227648    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227651    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227653    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227656    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227658    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227661    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227664    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227667    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227670    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227672    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227675    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227677    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227680    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227683    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227685    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.238727 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227688    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227690    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227693    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227695    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227698    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227702    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227705    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227707    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227711    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227714    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227717    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227720    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227722    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227725    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227727    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227730    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227732    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227735    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227737    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227740    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.239207 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227743    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227745    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227748    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227751    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227754    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227757    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227759    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227762    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227765    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227768    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227770    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227774    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227778    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227781    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227784    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227787    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227789    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227793    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227795    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.239665 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227798    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227800    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227803    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227806    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227808    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227811    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227814    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227816    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227819    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227821    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227824    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227826    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227829    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.227831    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.234542    2584 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.234558    2584 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.234574    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.234579    2584 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:54:49.240185 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234644    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234650    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234653    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234656    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234659    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234663    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234667    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234671    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234673    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234676    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234679    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234681    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234684    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234687    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234690    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234692    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234695    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234697    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234700    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.240606 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234702    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234705    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234707    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234710    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234712    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234715    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234717    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234720    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234723    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234725    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234736    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234739    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234741    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234744    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234747    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234750    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234752    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234755    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234758    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.241064 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234760    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234763    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234765    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234768    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234771    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234773    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234775    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234778    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234782    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234786    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234789    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234791    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234794    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234796    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234799    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234801    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234804    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234806    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234809    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.241509 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234812    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234814    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234817    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234820    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234823    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234837    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234840    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234843    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234846    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234848    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234851    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234853    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234856    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234858    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234860    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234863    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234865    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234868    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234870    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234873    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.241961 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234875    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234878    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234880    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234883    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234886    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234888    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234891    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234893    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234896    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234898    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234901    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234903    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234906    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234908    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234911    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234913    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234916    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234919    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234927    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234930    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.242445 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234933    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234935    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234938    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234940    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234943    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234945    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234948    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234950    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.234952    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.234991    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235195    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235200    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235202    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235205    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235208    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235210    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.242963 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235212    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235215    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235218    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235220    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235223    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235225    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235227    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235230    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235232    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235235    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235237    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235240    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235243    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235245    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235248    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.235292    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236026    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236038    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236043    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236049    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.243346 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236053    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236058    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236067    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236075    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236081    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236086    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236090    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236103    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236108    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236112    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236118    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236123    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236128    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236133    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236139    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236143    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236149    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236154    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236159    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.243831 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236169    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236174    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236178    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236183    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236188    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236194    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236198    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236203    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236208    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236248    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236253    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236258    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236263    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236273    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236278    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236283    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236288    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236292    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236297    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236301    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.244295 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236306    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236311    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236316    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236320    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236325    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236442    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236566    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236571    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236575    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236578    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236581    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236584    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236587    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236590    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236592    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236595    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236598    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236600    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236603    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.244800 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236606    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236608    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236611    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236615    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236621    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236625    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236628    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236630    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236633    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236636    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236639    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236641    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236644    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236647    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236649    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236652    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236655    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236657    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236660    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.245330 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236663    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236666    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236669    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.236700    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236752    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236757    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236760    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236763    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236766    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236768    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236771    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236774    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236777    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236779    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236782    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236785    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:54:49.245856 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236787    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236791    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236793    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236796    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236798    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236801    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236803    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236806    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236809    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236813    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236816    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236819    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236822    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236825    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236827    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236830    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236833    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236836    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236839    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236842    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:54:49.246247 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236844    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236847    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236850    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236852    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236855    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236857    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236859    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236862    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236865    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236867    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236869    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236872    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236875    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236877    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236880    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236882    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236885    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236887    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236890    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:54:49.246769 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236893    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236895    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236898    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236901    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236903    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236906    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236908    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236911    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236913    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236926    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236930    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236933    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236936    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236938    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236941    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236945    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236947    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236950    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236953    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:54:49.247306 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236955    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236958    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236961    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236963    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236966    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236983    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236986    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236989    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236991    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236995    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.236999    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237002    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237005    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237008    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237010    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237013    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237015    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237018    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237020    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:54:49.247926 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237023    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237025    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237028    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237031    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237033    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237038    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237040    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237044    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237047    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237049    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237052    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237054    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237057    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237059    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237062    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237064    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:49.237067    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.237117    2584 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.241486    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 02:54:49.248409 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.242393    2584 server.go:1014] "Starting client certificate rotation"
Oct 30 02:54:49.248854 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.242489    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:54:49.248854 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.243387    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:54:49.248854 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.244506    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:54:49.248854 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.245585    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:54:49.253368 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.253354    2584 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:54:49.256396 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.256382    2584 log.go:25] "Validated CRI v1 image API"
Oct 30 02:54:49.257301 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.257258    2584 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:54:49.261321 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.261297    2584 fs.go:135] Filesystem UUIDs: map[040c31cd-dcdd-4c4e-9d57-dbce2c407838:/dev/nvme0n1p4 5a3d83e3-3e26-44eb-a75b-8de59dc54219:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 02:54:49.261386 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.261319    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 02:54:49.266978 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.266859    2584 manager.go:217] Machine: {Timestamp:2026-10-30 02:54:49.265541524 +0000 UTC m=+0.332750459 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096500 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b2ea8b1011694ed5088bcd8f6f99 SystemUUID:ec24b2ea-8b10-1169-4ed5-088bcd8f6f99 BootID:e5e39d82-5223-43ac-917f-7debe6760832 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f5:26:3e:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f5:26:3e:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:d5:11:94:27:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:54:49.266978 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.266965    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:54:49.267098 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.267046    2584 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:54:49.270609 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270584    2584 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:54:49.270729 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270611    2584 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:54:49.270779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270731    2584 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:54:49.270779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270739    2584 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:54:49.270779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270762    2584 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:54:49.270853 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.270780    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:54:49.271522 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.271512    2584 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:54:49.275621 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.275609    2584 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:54:49.275733 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.275724    2584 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:54:49.276841 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.276832    2584 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:54:49.276877 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.276845    2584 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:54:49.276877 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.276862    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:54:49.276877 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.276874    2584 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:54:49.276999 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.276883    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:54:49.277269 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.277244    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:54:49.279778 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.279759    2584 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:54:49.285496 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.285478    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:54:49.286303 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286288    2584 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:54:49.286350 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286337    2584 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:54:49.286541 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286526    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:54:49.286582 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286553    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:54:49.286582 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286562    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:54:49.286582 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286571    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:54:49.286582 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286580    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:54:49.286682 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.286590    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:54:49.287100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287089    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:54:49.287136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287102    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:54:49.287136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287110    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:54:49.287136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287117    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:54:49.287136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287125    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:54:49.287136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287135    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:54:49.287859 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287849    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:54:49.287889 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.287863    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:54:49.291627 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.291612    2584 server.go:1263] "Started kubelet"
Oct 30 02:54:49.291748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.291705    2584 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:54:49.291795 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.291701    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:54:49.291795 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.291779    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:54:49.292298 ip-10-0-136-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:54:49.292799 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.292783    2584 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:54:49.293419 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.293403    2584 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:54:49.300021 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.300005    2584 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 02:54:49.301134 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.301119    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:54:49.301681 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.301663    2584 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:54:49.301774 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.301751    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.302207 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302191    2584 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:54:49.302207 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302209    2584 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:54:49.302346 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302189    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:54:49.302397 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302357    2584 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:54:49.302397 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302367    2584 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:54:49.302543 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302527    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:54:49.302543 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302541    2584 factory.go:55] Registering systemd factory
Oct 30 02:54:49.302671 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302549    2584 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:54:49.302769 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302754    2584 factory.go:153] Registering CRI-O factory
Oct 30 02:54:49.302805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302773    2584 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:54:49.302805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302786    2584 factory.go:103] Registering Raw factory
Oct 30 02:54:49.302805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.302798    2584 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:54:49.303684 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.303665    2584 manager.go:319] Starting recovery of all containers
Oct 30 02:54:49.316304 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.316280    2584 manager.go:324] Recovery completed
Oct 30 02:54:49.321784 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.321768    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.323377 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323344    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.323442 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323390    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.323442 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323403    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.323899 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323884    2584 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:54:49.323947 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323899    2584 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:54:49.323947 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323920    2584 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:54:49.323947 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.323921    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.324573 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.324551    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.324660 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.324586    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.324660 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.324603    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.326164 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.326150    2584 policy_none.go:50] "Start"
Oct 30 02:54:49.326240 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.326166    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:54:49.326240 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.326179    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:54:49.326899 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.326880    2584 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 02:54:49.326899 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.326889    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 02:54:49.328084 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.326883    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18e32f1f93aba8d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-10-30 02:54:49.291581655 +0000 UTC m=+0.358790584,LastTimestamp:2026-10-30 02:54:49.291581655 +0000 UTC m=+0.358790584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}"
Oct 30 02:54:49.328223 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.328176    2584 policy_none.go:44] "Start"
Oct 30 02:54:49.334154 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.334133    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:54:49.350005 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.349985    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 02:54:49.350076 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.349993    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18e32f1f9590d039  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-10-30 02:54:49.323376697 +0000 UTC m=+0.390585630,LastTimestamp:2026-10-30 02:54:49.323376697 +0000 UTC m=+0.390585630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}"
Oct 30 02:54:49.350179 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.350163    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 02:54:49.356558 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.356533    2584 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:54:49.359019 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359006    2584 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:54:49.359074 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.359035    2584 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:54:49.359074 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359046    2584 server.go:87] "Starting device plugin registration server"
Oct 30 02:54:49.359241 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359231    2584 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:54:49.359282 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359243    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:54:49.359331 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359310    2584 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:54:49.359393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359378    2584 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:54:49.359393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.359393    2584 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:54:49.359813 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.359795    2584 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:54:49.359876 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.359846    2584 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.363149 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.363130    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 02:54:49.370185 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.370167    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxlql"
Oct 30 02:54:49.372884 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.372816    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18e32f1f95911f2d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-10-30 02:54:49.323396909 +0000 UTC m=+0.390605836,LastTimestamp:2026-10-30 02:54:49.323396909 +0000 UTC m=+0.390605836,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}"
Oct 30 02:54:49.378468 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.378451    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxlql"
Oct 30 02:54:49.400096 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.391175    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18e32f1f95914671  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-10-30 02:54:49.323406961 +0000 UTC m=+0.390615889,LastTimestamp:2026-10-30 02:54:49.323406961 +0000 UTC m=+0.390615889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}"
Oct 30 02:54:49.424112 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.424083    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:54:49.425208 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.425194    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:54:49.425288 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.425215    2584 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:54:49.425288 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.425239    2584 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:54:49.425288 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.425274    2584 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 02:54:49.440745 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.440730    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:54:49.459820 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.459807    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.460516 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.460501    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.460580 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.460531    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.460580 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.460544    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.460580 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.460571    2584 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.481180 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.481143    2584 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.481180 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.481162    2584 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-202.ec2.internal\": node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.518063 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.518043    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.526128 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.526106    2584 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"]
Oct 30 02:54:49.526206 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.526155    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.526821 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.526808    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.526879 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.526835    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.526879 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.526846    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.529078 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529066    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.529224 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.529261 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529238    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.529741 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529724    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.529741 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529732    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.529839 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529751    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.529839 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529754    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.529839 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529762    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.529839 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.529767    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.531880 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.531865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.531979 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.531891    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:49.532542 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.532526    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:49.532604 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.532550    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:49.532604 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.532565    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:49.557647 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.557524    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-202.ec2.internal\" not found" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.559995 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.559963    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-202.ec2.internal\" not found" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.603561 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.603543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.603633 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.603572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.603633 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.603595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.618753 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.618722    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.704208 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.704296 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704233    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.704296 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704265    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.704296 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.704389 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704309    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.704389 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.704341    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.719194 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.719175    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.820301 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.820262    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:49.860535 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.860518    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.863549 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:49.863534    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:49.920875 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:49.920857    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:50.021412 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:50.021385    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:50.121858 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:50.121814    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:51.625073 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:51.625053    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:51.645217 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.645192    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 02:54:51.645335 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.645317    2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 02:54:51.725990 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:51.725972    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:51.787036 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.786991    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:49:50 +0000 UTC" deadline="2028-05-27 16:47:00.86519353 +0000 UTC"
Oct 30 02:54:51.787036 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.787036    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13813h52m9.078161324s"
Oct 30 02:54:51.827010 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:51.826985    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:51.909022 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:51.908989    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f55a681f1d4144d42dc77996364937.slice/crio-3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1 WatchSource:0}: Error finding container 3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1: Status 404 returned error can't find the container with id 3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1
Oct 30 02:54:51.909231 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:51.909211    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7d0a5578df212c9c3593b8eec7e8e4.slice/crio-522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424 WatchSource:0}: Error finding container 522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424: Status 404 returned error can't find the container with id 522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424
Oct 30 02:54:51.913319 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.913305    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 02:54:51.927416 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:51.927398    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:51.934685 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.934672    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:54:51.935917 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.935903    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:54:51.936013 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.935932    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:54:51.936013 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:51.935948    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:54:52.013005 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.012983    2584 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:54:52.028061 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.028043    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:52.128647 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.128607    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:52.229288 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.229266    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:52.329911 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.329893    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:54:52.363931 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.363906    2584 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:54:52.364353 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.364178    2584 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:54:52.404620 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.404553    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:52.423939 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.423919    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:54:52.424906 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.424885    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:54:52.448592 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.448556    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:54:52.681135 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.681068    2584 apiserver.go:52] "Watching apiserver"
Oct 30 02:54:52.704735 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.704707    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 02:54:52.709366 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.708276    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:54:52.709366 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.708515    2584 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:54:52.709366 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.708923    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8gbpm","kube-system/global-pull-secret-syncer-l6fz8","openshift-multus/multus-additional-cni-plugins-td8hm","openshift-network-diagnostics/network-check-target-qmgzm","kube-system/konnectivity-agent-k2fmn","openshift-network-operator/iptables-alerter-xgfjk","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-9z9fv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf","openshift-cluster-node-tuning-operator/tuned-cz5h7","openshift-dns/node-resolver-6n4q9","openshift-image-registry/node-ca-s56gp","openshift-multus/multus-lrd2x"]
Oct 30 02:54:52.711726 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.711702    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.713877 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.713851    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.716116 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.716098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.718977 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.718961    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.721021 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.720995    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.721105 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.721065    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:54:52.723687 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.723663    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.726499 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.726451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.728048 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728029    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:54:52.728399 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728383    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:54:52.728463 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728440    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:54:52.728515 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728503    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:54:52.728606 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728569    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.728700 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.728686    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fdxtg\""
Oct 30 02:54:52.729287 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.729268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.731232 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.730945    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.731429 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.731413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.733546 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.733526    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:52.733653 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.733604    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:54:52.736778 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.736758    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.739280 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.739263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.739445 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.739328    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:54:52.780512 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.780483    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:54:52.780634 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.780569    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sg6kr"
Oct 30 02:54:52.791452 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.791429    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sg6kr"
Oct 30 02:54:52.806613 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.806596    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:54:52.816777 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.816753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.816867 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.816792    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.816867 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.816818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qzzc\" (UniqueName: \"kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.816980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.816901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.816980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.816971    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.817075 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817075 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817026    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817075 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817066    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.817194 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.817194 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.817274 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817274 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817274 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817348    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817467 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqfr\" (UniqueName: \"kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817565    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817627    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817707    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817733    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9xk\" (UniqueName: \"kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.817823 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817800    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817904    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lmb\" (UniqueName: \"kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817955    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.817980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818088    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818102    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818172 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6kr\" (UniqueName: \"kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946v9\" (UniqueName: \"kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818343    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbb5q\" (UniqueName: \"kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818425    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8kmr\" (UniqueName: \"kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.818563 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818439    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818467    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818653    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjxwf\" (UniqueName: \"kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818710    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818777    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.819136 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.819846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818871    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.819846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.819846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.819846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.818916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.830979 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.830956    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:54:52.831129 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831106    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:54:52.831218 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831199    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.831429 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831413    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:54:52.831535 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831527    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:54:52.831628 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831558    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.831628 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831610    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mk2hv\""
Oct 30 02:54:52.831740 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831654    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:54:52.831740 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831675    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kn7z4\""
Oct 30 02:54:52.831841 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831752    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8ljf8\""
Oct 30 02:54:52.831893 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831857    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ft4zm\""
Oct 30 02:54:52.831942 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831913    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-chr82\""
Oct 30 02:54:52.831942 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831927    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.832045 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831970    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.832045 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831989    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tpj88\""
Oct 30 02:54:52.832045 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832006    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.832045 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832024    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832060    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6gpqv\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832070    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832073    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831933    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832095    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.831859    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832143    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832179    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9qpgh\""
Oct 30 02:54:52.832229 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832206    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:54:52.832496 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832270    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:54:52.832496 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832272    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.832496 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.832182    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:54:52.833917 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.833882    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerStarted","Data":"522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424"}
Oct 30 02:54:52.835015 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.834994    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"13f55a681f1d4144d42dc77996364937","Type":"ContainerStarted","Data":"3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1"}
Oct 30 02:54:52.919785 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.919916 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.919916 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919886    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.919916 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919892    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.920083 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.920083 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.919975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.920083 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.920083 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920013    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.920083 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920157    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6kr\" (UniqueName: \"kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920316 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946v9\" (UniqueName: \"kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920434    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbb5q\" (UniqueName: \"kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920523    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8kmr\" (UniqueName: \"kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920634    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.920802 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920774    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920819    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjxwf\" (UniqueName: \"kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920944    2584 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921166    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921291    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921347    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921366    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.921508 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921378    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921559    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921684    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921771    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921814    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921849    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921872    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921878    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921912    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921921    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921941    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921989    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.921996    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922018    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922058    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922128    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922165    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922207    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.922272 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922261    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922270    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922313    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.922444    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.922525    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:53.422491416 +0000 UTC m=+3.087093267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.920965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922531    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922673    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922696    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922719    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qzzc\" (UniqueName: \"kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922775    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923028 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922829    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922928    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923285    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.922871    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923338    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923349    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923505    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923599    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923652    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.923805 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqfr\" (UniqueName: \"kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9xk\" (UniqueName: \"kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.924557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lmb\" (UniqueName: \"kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924327    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924362    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924391    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.923652    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924445    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924451    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924496    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924514    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924563    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924623    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924661    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924665    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924703    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924851    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.925337 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924922    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.924951    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.925001    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925007    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.925048    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:53.425032991 +0000 UTC m=+3.089634830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925052    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925072    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925094    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925143    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925151    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925153    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925195    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.925706    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:52.926158 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.926108    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.926666 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.926230    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.928115 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.928095    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.929251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.929221    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:52.948242 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.947186    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:54:52.948242 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.947212    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:54:52.948242 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.947225    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:52.948242 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:52.947282    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:54:53.44726722 +0000 UTC m=+3.111869049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:52.948242 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.947625    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6kr\" (UniqueName: \"kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:52.950490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.950443    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbb5q\" (UniqueName: \"kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:52.951216 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.950754    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjxwf\" (UniqueName: \"kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:52.952210 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.952083    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946v9\" (UniqueName: \"kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:52.955662 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.955639    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lmb\" (UniqueName: \"kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:52.956173 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.956149    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8kmr\" (UniqueName: \"kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:52.956173 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.956162    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqfr\" (UniqueName: \"kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:52.956173 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.956168    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qzzc\" (UniqueName: \"kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:52.956355 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:52.956163    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9xk\" (UniqueName: \"kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:53.038936 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.038909    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lrd2x"
Oct 30 02:54:53.045242 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.045222    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:54:53.048955 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.048933    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:54:53.050019 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.050005    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:54:53.055341 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.055313    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ec5656_f9f4_4a45_a60f_f31fd5e569b9.slice/crio-c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30 WatchSource:0}: Error finding container c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30: Status 404 returned error can't find the container with id c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30
Oct 30 02:54:53.062070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.062050    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:54:53.063019 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.062995    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1fec2d_c429_4c09_bff4_330ff2e95935.slice/crio-cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58 WatchSource:0}: Error finding container cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58: Status 404 returned error can't find the container with id cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58
Oct 30 02:54:53.063776 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.063754    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8814d09f_6e78_4cb5_9536_16527a4b1d30.slice/crio-7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc WatchSource:0}: Error finding container 7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc: Status 404 returned error can't find the container with id 7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc
Oct 30 02:54:53.064392 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.064305    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b6b191_b504_4b31_add7_fdc98bea9aec.slice/crio-0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064 WatchSource:0}: Error finding container 0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064: Status 404 returned error can't find the container with id 0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064
Oct 30 02:54:53.070198 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.070162    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:54:53.070911 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.070882    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4767108b_7fd3_45da_9ea7_7f076f96034b.slice/crio-686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02 WatchSource:0}: Error finding container 686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02: Status 404 returned error can't find the container with id 686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02
Oct 30 02:54:53.078972 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.078951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:54:53.088406 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.088387    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:54:53.102920 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.102820    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297ad00c_8e12_4e27_94d0_4d10d1e4ed0c.slice/crio-451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef WatchSource:0}: Error finding container 451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef: Status 404 returned error can't find the container with id 451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef
Oct 30 02:54:53.106495 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.106478    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:54:53.118270 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:54:53.118249    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512891c4_1cba_468a_aafb_0c016eb455c2.slice/crio-7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1 WatchSource:0}: Error finding container 7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1: Status 404 returned error can't find the container with id 7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1
Oct 30 02:54:53.429702 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.429672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:53.429842 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.429735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:53.429842 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.429829    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:53.429941 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.429853    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:53.429941 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.429903    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:54.429882495 +0000 UTC m=+4.094484335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:53.429941 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.429917    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:54.429911005 +0000 UTC m=+4.094512831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:53.530920 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.530841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:53.531079 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.531000    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:54:53.531079 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.531019    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:54:53.531079 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.531031    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:53.531284 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:53.531084    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:54:54.53106554 +0000 UTC m=+4.195667382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:53.795926 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.795803    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:49:52 +0000 UTC" deadline="2028-03-30 02:35:46.079801822 +0000 UTC"
Oct 30 02:54:53.795926 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.795861    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12407h40m52.283944936s"
Oct 30 02:54:53.846191 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.846060    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerStarted","Data":"7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1"}
Oct 30 02:54:53.852298 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.852216    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cz5h7" event={"ID":"96c52d37-b38b-48d0-a335-ca4b56fa97d4","Type":"ContainerStarted","Data":"e89c1cd6b3c2db449b1fdcf7f1502e1f95b69ae56c7412482e6b7aa53bb06da6"}
Oct 30 02:54:53.856725 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.856646    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2fmn" event={"ID":"ad3e816f-1810-4e16-9392-f393580c75b3","Type":"ContainerStarted","Data":"da4a70f6bf3e5ef023af359abba9486ecfcb02302d3ea935666fa3278b1231da"}
Oct 30 02:54:53.871045 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.869325    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgfjk" event={"ID":"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c","Type":"ContainerStarted","Data":"451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef"}
Oct 30 02:54:53.873723 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.873614    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf" event={"ID":"4767108b-7fd3-45da-9ea7-7f076f96034b","Type":"ContainerStarted","Data":"686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02"}
Oct 30 02:54:53.885803 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.885774    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s56gp" event={"ID":"18b6b191-b504-4b31-add7-fdc98bea9aec","Type":"ContainerStarted","Data":"0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064"}
Oct 30 02:54:53.889762 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.889718    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6n4q9" event={"ID":"8814d09f-6e78-4cb5-9536-16527a4b1d30","Type":"ContainerStarted","Data":"7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc"}
Oct 30 02:54:53.905623 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.905525    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58"}
Oct 30 02:54:53.925610 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.924659    2584 generic.go:356] "Generic (PLEG): container finished" podID="4c7d0a5578df212c9c3593b8eec7e8e4" containerID="8b9acff20e60fa1c29686849ee766f61b22667272870bbab7210ec65d377030a" exitCode=0
Oct 30 02:54:53.925610 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.924740    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerDied","Data":"8b9acff20e60fa1c29686849ee766f61b22667272870bbab7210ec65d377030a"}
Oct 30 02:54:53.940605 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.940565    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"13f55a681f1d4144d42dc77996364937","Type":"ContainerStarted","Data":"f9c4322dbd7b3d1e68c96549c271216d113acd8e375b7ecfd598e4fd937a54a9"}
Oct 30 02:54:53.952032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:53.952006    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrd2x" event={"ID":"78ec5656-f9f4-4a45-a60f-f31fd5e569b9","Type":"ContainerStarted","Data":"c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30"}
Oct 30 02:54:54.437659 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.437538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:54.437825 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.437712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:54.437886 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.437867    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:54.437939 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.437924    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:56.437907263 +0000 UTC m=+6.102509090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:54.438002 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.437993    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:54.438052 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.438028    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:54:56.438017009 +0000 UTC m=+6.102618842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:54.538935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.538901    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:54.539107 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.539090    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:54:54.539170 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.539116    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:54:54.539170 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.539128    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:54.539259 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.539182    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:54:56.539165059 +0000 UTC m=+6.203766899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:54.799884 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.799709    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:49:52 +0000 UTC" deadline="2028-05-28 18:48:10.382448851 +0000 UTC"
Oct 30 02:54:54.799884 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.799771    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13839h53m15.582681553s"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.831061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.831205    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.831610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.831697    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.831758    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:54.832381 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:54.831836    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:54:54.972667 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:54.972637    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerStarted","Data":"85cf70d1423199c1f399b772b088c9aeabff8552aede898d5c9c1af1995accee"}
Oct 30 02:54:55.015652 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:55.014710    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" podStartSLOduration=3.014692365 podStartE2EDuration="3.014692365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:54:54.006216552 +0000 UTC m=+3.670818403" watchObservedRunningTime="2026-10-30 02:54:55.014692365 +0000 UTC m=+4.679294213"
Oct 30 02:54:55.015652 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:55.014814    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" podStartSLOduration=3.01480611 podStartE2EDuration="3.01480611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:54:55.014411736 +0000 UTC m=+4.679013587" watchObservedRunningTime="2026-10-30 02:54:55.01480611 +0000 UTC m=+4.679407960"
Oct 30 02:54:55.979803 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:55.979730    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerStarted","Data":"bb8f57a6129857aef4bb5cff35e6b92a860afa27915f545ba38c5ddb373dd3df"}
Oct 30 02:54:56.454405 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.454369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:56.454598 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.454436    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:56.454598 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.454559    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:56.454864 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.454622    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:00.454609256 +0000 UTC m=+10.119211096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:54:56.455035 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.455012    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:56.455109 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.455075    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:00.455059397 +0000 UTC m=+10.119661237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:54:56.555287 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.555251    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:56.555438 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.555427    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:54:56.555493 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.555446    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:54:56.555493 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.555460    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:56.555631 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.555513    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:00.555496246 +0000 UTC m=+10.220098093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:54:56.829783 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.829680    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:56.829783 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.829700    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:56.830062 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.829817    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:54:56.830062 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.829835    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:56.830062 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.829925    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:54:56.830062 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:56.830005    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:54:56.995064 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.995023    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="bb8f57a6129857aef4bb5cff35e6b92a860afa27915f545ba38c5ddb373dd3df" exitCode=0
Oct 30 02:54:56.995501 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:56.995093    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"bb8f57a6129857aef4bb5cff35e6b92a860afa27915f545ba38c5ddb373dd3df"}
Oct 30 02:54:58.002935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:58.002243    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2fmn" event={"ID":"ad3e816f-1810-4e16-9392-f393580c75b3","Type":"ContainerStarted","Data":"4132c4f5ecd2705e04302ae3e100cff2a63e451670722d40eb7037c85fdd911c"}
Oct 30 02:54:58.831568 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:58.831502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:54:58.831769 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:58.831648    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:54:58.832342 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:58.832021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:54:58.832342 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:58.832117    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:54:58.832342 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:58.832177    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:54:58.832342 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:54:58.832259    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:54:59.007501 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:59.007359    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf" event={"ID":"4767108b-7fd3-45da-9ea7-7f076f96034b","Type":"ContainerStarted","Data":"c6545c98942971c2fd55b182f56f23c2a9d9d0ee1d74db9b6b8866f88900454e"}
Oct 30 02:54:59.010533 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:59.010507    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s56gp" event={"ID":"18b6b191-b504-4b31-add7-fdc98bea9aec","Type":"ContainerStarted","Data":"16566f01766e666a8fa05658822d0cd07fe3fe77b9e0dc597837db210963bc7c"}
Oct 30 02:54:59.053423 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:59.053381    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k2fmn" podStartSLOduration=4.274878255 podStartE2EDuration="8.053368142s" totalImagesPullingTime="3.778489887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:54:58.041664719 +0000 UTC m=+7.706266569" watchObservedRunningTime="2026-10-30 02:54:59.053368142 +0000 UTC m=+8.717969989"
Oct 30 02:54:59.053948 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:54:59.053910    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s56gp" podStartSLOduration=4.259669894 podStartE2EDuration="9.053901948s" totalImagesPullingTime="4.794232054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:54:59.053718237 +0000 UTC m=+8.718320086" watchObservedRunningTime="2026-10-30 02:54:59.053901948 +0000 UTC m=+8.718503795"
Oct 30 02:55:00.340286 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.340260    2584 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:55:00.493787 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.493705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:00.493787 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.493755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:00.493981 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.493870    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:00.493981 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.493919    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:08.493904701 +0000 UTC m=+18.158506540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:00.494215 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.494191    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:00.494342 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.494228    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:08.494218503 +0000 UTC m=+18.158820342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:00.594908 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.594878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:00.595061 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.595044    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:00.595106 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.595069    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:00.595106 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.595082    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:00.595198 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.595140    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:08.595120882 +0000 UTC m=+18.259722710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:00.767992 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.767204    2584 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:55:00.340279189Z","UUID":"fa5d3cea-a7f0-4546-9e31-dc241dcde12d","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:55:00.769920 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.769002    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:55:00.769920 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.769056    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.829311    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.829391    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.829689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.829752    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:00.829796    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:00.830382 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:00.829838    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:01.019061 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:01.018987    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf" event={"ID":"4767108b-7fd3-45da-9ea7-7f076f96034b","Type":"ContainerStarted","Data":"6ad752d81c585037962995a1fb44bdbfd1768256409dca232d77e6d896f0d154"}
Oct 30 02:55:01.021195 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:01.021164    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6n4q9" event={"ID":"8814d09f-6e78-4cb5-9536-16527a4b1d30","Type":"ContainerStarted","Data":"16776b09285dba07fe729704aea8b527f2a6d17a6b0033f10708b75f03e45458"}
Oct 30 02:55:01.023960 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:01.023560    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lrd2x" event={"ID":"78ec5656-f9f4-4a45-a60f-f31fd5e569b9","Type":"ContainerStarted","Data":"2b9bb90384f6d6e163d057f0aaaff0b3c5097764ed281d6567085a8b124a3667"}
Oct 30 02:55:01.059321 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:01.059276    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-6n4q9" podStartSLOduration=3.580415438 podStartE2EDuration="11.059253952s" totalImagesPullingTime="7.478838514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:01.058853398 +0000 UTC m=+10.723455247" watchObservedRunningTime="2026-10-30 02:55:01.059253952 +0000 UTC m=+10.723855804"
Oct 30 02:55:01.101758 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:01.100556    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-lrd2x" podStartSLOduration=3.475176009 podStartE2EDuration="11.100542131s" totalImagesPullingTime="7.625366122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:01.100411339 +0000 UTC m=+10.765013187" watchObservedRunningTime="2026-10-30 02:55:01.100542131 +0000 UTC m=+10.765143973"
Oct 30 02:55:02.028404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.028096    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="8cbb15123504696e7cafd8bda70d225920e600e738f402241e4936b42b2cce3b" exitCode=0
Oct 30 02:55:02.028404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.028315    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"8cbb15123504696e7cafd8bda70d225920e600e738f402241e4936b42b2cce3b"}
Oct 30 02:55:02.031227 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.031203    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf" event={"ID":"4767108b-7fd3-45da-9ea7-7f076f96034b","Type":"ContainerStarted","Data":"01dc6311fada88b8113ec2e247d5474bcec005f43135ef3b5093bd8746f09108"}
Oct 30 02:55:02.140792 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.140687    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf" podStartSLOduration=3.22276011 podStartE2EDuration="11.140666858s" totalImagesPullingTime="7.917906748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:02.140393212 +0000 UTC m=+11.804995059" watchObservedRunningTime="2026-10-30 02:55:02.140666858 +0000 UTC m=+11.805268707"
Oct 30 02:55:02.252423 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.252390    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:02.252609 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.252514    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:02.828713 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.828686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:02.828713 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.828706    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:02.828935 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:02.828812    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:02.829142 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:02.829124    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:02.829247 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:02.829221    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:02.829361 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:02.829299    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:03.034568 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:03.034529    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgfjk" event={"ID":"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c","Type":"ContainerStarted","Data":"59e20e13be4e20b7a01e53f8b9eb4bf1d3ef234168eee1d521ac4dbd160fcbbd"}
Oct 30 02:55:03.037001 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:03.036968    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerStarted","Data":"791d7fbe1ed73bd374fecb9c51aaea384e1e0e8ea626c8ce861433df4109991b"}
Oct 30 02:55:03.072332 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:03.072295    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xgfjk" podStartSLOduration=4.115141025 podStartE2EDuration="12.072283216s" totalImagesPullingTime="7.957142191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:03.072242012 +0000 UTC m=+12.736843858" watchObservedRunningTime="2026-10-30 02:55:03.072283216 +0000 UTC m=+12.736885064"
Oct 30 02:55:04.041197 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.041157    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="791d7fbe1ed73bd374fecb9c51aaea384e1e0e8ea626c8ce861433df4109991b" exitCode=0
Oct 30 02:55:04.041865 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.041238    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"791d7fbe1ed73bd374fecb9c51aaea384e1e0e8ea626c8ce861433df4109991b"}
Oct 30 02:55:04.043070 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.043016    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cz5h7" event={"ID":"96c52d37-b38b-48d0-a335-ca4b56fa97d4","Type":"ContainerStarted","Data":"ffbff1fcf9647c56742a3c4e4e2ae5aaf529d84dba1fa4749783c0a354eac896"}
Oct 30 02:55:04.137305 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.137249    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cz5h7" podStartSLOduration=3.05444256 podStartE2EDuration="13.137231835s" totalImagesPullingTime="10.082789275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:04.136859152 +0000 UTC m=+13.801461002" watchObservedRunningTime="2026-10-30 02:55:04.137231835 +0000 UTC m=+13.801833684"
Oct 30 02:55:04.828779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.828629    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:04.828779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.828670    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:04.828779 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:04.828629    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:04.828779 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:04.828740    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:04.828967 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:04.828800    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:04.828967 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:04.828894    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:05.047408 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:05.047328    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="ed2e3907ad88399779880e3497a03080bbe023471f78aeb81bdd67b436a22d5a" exitCode=0
Oct 30 02:55:05.047980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:05.047411    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"ed2e3907ad88399779880e3497a03080bbe023471f78aeb81bdd67b436a22d5a"}
Oct 30 02:55:06.828999 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:06.828823    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:06.829332 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:06.828824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:06.829332 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:06.829078    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:06.829332 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:06.828844    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:06.829332 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:06.829164    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:06.829332 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:06.829262    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:07.063773 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:07.063749    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="1ef56a66ef5b28855173c0003655b7446c52efb597f2b8c1b6381a18a8b4c69c" exitCode=0
Oct 30 02:55:07.063867 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:07.063795    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"1ef56a66ef5b28855173c0003655b7446c52efb597f2b8c1b6381a18a8b4c69c"}
Oct 30 02:55:08.068794 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.068588    2584 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="7f8a7e18bd1c08368198db01f531ff3b5d0a17b113d80445d9f0e1dd28bddbdf" exitCode=0
Oct 30 02:55:08.069296 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.068674    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerDied","Data":"7f8a7e18bd1c08368198db01f531ff3b5d0a17b113d80445d9f0e1dd28bddbdf"}
Oct 30 02:55:08.071846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.071825    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"b27cc25bb0ab1582f7cbce000c100ff1e2e7c8556a338ec7245c84943e8ebbd7"}
Oct 30 02:55:08.071923 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.071888    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"6f929a2a83b9ba4c370705c6150dab91b24d7bc424f12ad3c31b5415dad0f37d"}
Oct 30 02:55:08.071972 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.071924    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"f8fc659250c4948d7cec35a274a7d624771012b0aee1e1b3b828860d0cdebe82"}
Oct 30 02:55:08.071972 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.071955    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"1db86b56ae380f2ec9b821bf11ad3ca6aa4b4ea5258dd86c778cc16ad72efc13"}
Oct 30 02:55:08.072031 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.071991    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"c0d4604461fb9721b6057e3b45e513721d1097e5dc52b5a13bc7a241ca19fae4"}
Oct 30 02:55:08.072031 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.072020    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"efbdff0794bc92f38b63879147ebc3e6d87cc26ff834a7ce738c034f3760e99f"}
Oct 30 02:55:08.558355 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.558296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:08.558355 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.558344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:08.558552 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.558449    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:08.558552 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.558489    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:08.558552 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.558512    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:24.558493036 +0000 UTC m=+34.223094867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:08.558552 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.558535    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret podName:fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:24.558523348 +0000 UTC m=+34.223125187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret") pod "global-pull-secret-syncer-l6fz8" (UID: "fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:08.659328 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.659305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:08.659428 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.659420    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:08.659466 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.659432    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:08.659466 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.659442    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mg4zs for pod openshift-network-diagnostics/network-check-target-qmgzm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:08.659527 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.659477    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs podName:6f88cfca-1150-49ac-812b-2b77442e467b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:24.659468363 +0000 UTC m=+34.324070203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg4zs" (UniqueName: "kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs") pod "network-check-target-qmgzm" (UID: "6f88cfca-1150-49ac-812b-2b77442e467b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:08.828417 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.828349    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:08.828417 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.828410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:08.828550 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:08.828409    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:08.828550 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.828499    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:08.828634 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.828567    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:08.828692 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:08.828672    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:09.076348 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:09.076324    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td8hm" event={"ID":"512891c4-1cba-468a-aafb-0c016eb455c2","Type":"ContainerStarted","Data":"314c0fcbbaa19357e48ea1ca61a309ef728c8983d167f2eee9a4a857b2a7e865"}
Oct 30 02:55:09.124129 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:09.124060    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-td8hm" podStartSLOduration=8.51897516 podStartE2EDuration="18.12404978s" totalImagesPullingTime="9.60507462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:09.12366186 +0000 UTC m=+18.788263707" watchObservedRunningTime="2026-10-30 02:55:09.12404978 +0000 UTC m=+18.788651627"
Oct 30 02:55:10.081719 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.081644    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"2a07265e3433fa33bf41fdeb669bbdc641d5400a755bbf883b69fed3bb05671c"}
Oct 30 02:55:10.681902 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.681873    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:10.682049 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.681985    2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:10.682435 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.682419    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:10.829666 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.829643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:10.829797 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:10.829710    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:10.829797 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.829730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:10.829920 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:10.829847    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:10.829920 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:10.829892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:10.830020 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:10.829974    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:12.089764 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.089508    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" event={"ID":"1a1fec2d-c429-4c09-bff4-330ff2e95935","Type":"ContainerStarted","Data":"7aab108ecf3554148620fc2fb7b4c19b2b76e6975d8faad3dffdbf9b076a75a2"}
Oct 30 02:55:12.090318 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.089855    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:12.090318 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.089907    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:12.090318 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.089948    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:12.105145 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.105124    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:12.105248 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.105221    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:12.174734 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.174644    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv" podStartSLOduration=7.796767796 podStartE2EDuration="22.174631149s" totalImagesPullingTime="14.377863353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:12.174170389 +0000 UTC m=+21.838772236" watchObservedRunningTime="2026-10-30 02:55:12.174631149 +0000 UTC m=+21.839232997"
Oct 30 02:55:12.828733 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.828704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:12.828891 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.828704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:12.828891 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:12.828821    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:12.828891 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:12.828830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:12.828975 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:12.828900    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:12.828975 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:12.828959    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:13.942612 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.942565    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmgzm"]
Oct 30 02:55:13.942963 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.942711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:13.942963 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:13.942795    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:13.943296 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.943270    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l6fz8"]
Oct 30 02:55:13.943424 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.943410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:13.943550 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:13.943518    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:13.953719 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.953697    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gbpm"]
Oct 30 02:55:13.953830 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:13.953781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:13.953884 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:13.953868    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:15.828331 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:15.828305    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:15.828331 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:15.828319    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:15.828837 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:15.828310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:15.828837 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:15.828419    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:15.828837 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:15.828505    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:15.828837 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:15.828597    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:17.828041 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:17.828015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:17.828482 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:17.828015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:17.828482 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:17.828114    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:17.828482 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:17.828015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:17.828482 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:17.828173    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:17.828482 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:17.828253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:19.828371 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:19.828192    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:19.828822 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:19.828229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:19.828822 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:19.828446    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gbpm" podUID="3c4d4295-8f60-43ba-bedd-3f62177e646a"
Oct 30 02:55:19.828822 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:19.828545    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6fz8" podUID="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a"
Oct 30 02:55:19.828822 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:19.828257    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:19.828822 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:19.828659    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmgzm" podUID="6f88cfca-1150-49ac-812b-2b77442e467b"
Oct 30 02:55:20.099294 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.099242    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeReady"
Oct 30 02:55:20.099396 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.099365    2584 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 02:55:20.145510 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.145479    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkprk"]
Oct 30 02:55:20.148668 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.148645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:20.150196 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.150172    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2g88s"]
Oct 30 02:55:20.152741 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.152721    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hxlmq"]
Oct 30 02:55:20.152841 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.152826    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:20.155263 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.155246    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"]
Oct 30 02:55:20.155359 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.155348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:20.159011 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.158992    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-nf7zn"]
Oct 30 02:55:20.159131 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.159112    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.162123 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.162104    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:55:20.162223 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.162211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.165115 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.165098    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:55:20.165264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.165244    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.167714 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.167698    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74b8b5c987-q7zgf"]
Oct 30 02:55:20.168014 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.167885    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.172494 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.172444    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.175990 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.172696    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.176444 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.172891    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"]
Oct 30 02:55:20.176709 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.173016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.181870 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.181844    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f2mz6\""
Oct 30 02:55:20.182054 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.181964    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-jgdgr\""
Oct 30 02:55:20.182300 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.181859    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 02:55:20.182573 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.182525    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"]
Oct 30 02:55:20.183284 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.183258    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.185378 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.185346    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"]
Oct 30 02:55:20.185895 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.185875    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:20.190079 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.188339    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"]
Oct 30 02:55:20.191477 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.191034    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.191676 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.191659    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-54724"]
Oct 30 02:55:20.192565 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.192546    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.194852 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.194835    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"]
Oct 30 02:55:20.194949 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.194915    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.198688 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.198670    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"]
Oct 30 02:55:20.198828 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.198812    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.201654 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.201636    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkprk"]
Oct 30 02:55:20.201797 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.201780    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2g88s"]
Oct 30 02:55:20.201893 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.201811    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q2p4k"]
Oct 30 02:55:20.202369 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.201708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:20.205327 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.205309    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ndt7q"]
Oct 30 02:55:20.206146 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.205853    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.209067 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209050    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"]
Oct 30 02:55:20.209202 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209190    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hxlmq"]
Oct 30 02:55:20.209299 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209289    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"]
Oct 30 02:55:20.209391 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209373    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:55:20.209490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209401    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:55:20.209490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209423    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"]
Oct 30 02:55:20.209490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209443    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"]
Oct 30 02:55:20.209490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209464    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b8b5c987-q7zgf"]
Oct 30 02:55:20.209490 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209482    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"]
Oct 30 02:55:20.209770 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209501    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ndt7q"]
Oct 30 02:55:20.209770 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209526    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-nf7zn"]
Oct 30 02:55:20.209770 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209543    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-54724"]
Oct 30 02:55:20.209770 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.209631    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.210395 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.210376    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"]
Oct 30 02:55:20.213180 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.213161    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"]
Oct 30 02:55:20.216142 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.216121    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2p4k"]
Oct 30 02:55:20.250624 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.250600    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.250710 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.250656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.250710 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.250683    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.250928    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251220    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251397    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251484    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.251692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251886    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.251979    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.252032 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44lk\" (UniqueName: \"kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.252264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252081    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.252264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.252264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbwh\" (UniqueName: \"kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh\") pod \"kas-connection-checker-685895c7c9-gkprk\" (UID: \"f5bb4192-b645-4e9e-8f49-1d1e546092aa\") " pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:20.252264 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.252404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.252404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57cr4\" (UniqueName: \"kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.252461 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.252695 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.252695 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.252695 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cht4n\" (UniqueName: \"kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n\") pod \"kas-connection-checker-685895c7c9-hxlmq\" (UID: \"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2\") " pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:20.252866 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252866 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.252971 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.252929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dsdg\" (UniqueName: \"kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg\") pod \"kas-connection-checker-685895c7c9-2g88s\" (UID: \"dab5c412-1558-4d16-88c2-0b3f3dd21790\") " pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:20.270971 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.270945    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271087 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271073    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271159 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271087    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271159 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271101    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271159 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271124    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 02:55:20.271159 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271129    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271159 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271149    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271196    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271227    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271242    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271243    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271278    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271303    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 02:55:20.271393 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271340    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271430    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271544    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271602    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271623    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271631    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271656    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271660    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271678    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271694    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:55:20.271716 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271699    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.272100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271828    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.272100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271830    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:20.272100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.271957    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.272100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.272095    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:55:20.283491 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283469    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 02:55:20.283491 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283486    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 02:55:20.283633 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283489    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:55:20.283633 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283527    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:55:20.283633 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283556    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 02:55:20.283748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283651    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 02:55:20.283748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283658    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 02:55:20.283748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283658    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 02:55:20.283748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283687    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 02:55:20.283748 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283689    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 02:55:20.283898 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283755    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 02:55:20.283898 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283854    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 02:55:20.283898 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283857    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 02:55:20.283898 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.283867    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 02:55:20.284068 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284053    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fwhc6\""
Oct 30 02:55:20.284124 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284086    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xzg75\""
Oct 30 02:55:20.284124 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284102    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9wgn\""
Oct 30 02:55:20.284198 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284191    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ph67z\""
Oct 30 02:55:20.284343 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284326    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rl6cl\""
Oct 30 02:55:20.284430 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284416    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rpnvj\""
Oct 30 02:55:20.284507 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284495    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v88tk\""
Oct 30 02:55:20.284628 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284614    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-88wxv\""
Oct 30 02:55:20.284689 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284674    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vvtsk\""
Oct 30 02:55:20.284755 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284696    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rwtzz\""
Oct 30 02:55:20.284755 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.284740    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57t79\""
Oct 30 02:55:20.294669 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.294651    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 02:55:20.295095 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.295074    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 02:55:20.295652 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.295635    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 02:55:20.295718 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.295664    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 02:55:20.354366 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354300    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.354366 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.354512 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.354512 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.354628 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354572    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.354690 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.354690 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqw5\" (UniqueName: \"kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5\") pod \"volume-data-source-validator-58c9f5f46d-2wmxc\" (UID: \"5869efa1-9154-450e-a09b-710f9a51dcfc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:20.354690 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.354835 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354705    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6pw\" (UniqueName: \"kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.354887 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnws7\" (UniqueName: \"kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.354941 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.354924    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.854896764 +0000 UTC m=+30.519498610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:20.354941 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354927    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.355055 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.354989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.355055 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.355145 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355149    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssb2n\" (UniqueName: \"kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.355251 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44lk\" (UniqueName: \"kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355539    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.355559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355563    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355560    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hx7\" (UniqueName: \"kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.355683    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.355696    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355698    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.355745    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.855725688 +0000 UTC m=+30.520327514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355692    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbwh\" (UniqueName: \"kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh\") pod \"kas-connection-checker-685895c7c9-gkprk\" (UID: \"f5bb4192-b645-4e9e-8f49-1d1e546092aa\") " pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.355945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356051    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crpb8\" (UniqueName: \"kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.356084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cr4\" (UniqueName: \"kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356101    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356201    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.356305    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.356380    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.856363457 +0000 UTC m=+30.520965299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356455    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.356810 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356745    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.357200 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.356849    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:20.357200 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.357200 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.357017    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.856983825 +0000 UTC m=+30.521585687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:20.357200 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.357404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cht4n\" (UniqueName: \"kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n\") pod \"kas-connection-checker-685895c7c9-hxlmq\" (UID: \"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2\") " pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:20.357404 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357267    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.357520 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.357597 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.357650 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.357754 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.356555    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.357754 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdg\" (UniqueName: \"kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg\") pod \"kas-connection-checker-685895c7c9-2g88s\" (UID: \"dab5c412-1558-4d16-88c2-0b3f3dd21790\") " pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:20.357908 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.357908 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357900    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.358016 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.358016 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.357958    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:20.358111 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.358076    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:20.358111 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.357989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwn9z\" (UniqueName: \"kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z\") pod \"network-check-source-6f78d59f99-q25gd\" (UID: \"21c64927-d977-4fa0-88fe-27c90b7dc9fc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:20.358214 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.358152    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.858120086 +0000 UTC m=+30.522721926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:20.358273 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.358225    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmsr\" (UniqueName: \"kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.358400 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.358275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6b7\" (UniqueName: \"kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.358692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.358534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.358692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.358564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.359863 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.359836    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.360267 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360248    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.360343 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360278    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.360557 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360531    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.360807 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360789    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.360865 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360809    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.360903 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.360892    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.376855 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.376837    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.382360 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.382324    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44lk\" (UniqueName: \"kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.382735 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.382714    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.383456 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.383433    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.383692 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.383638    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cr4\" (UniqueName: \"kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.383830 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.383812    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.383920 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.383902    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cht4n\" (UniqueName: \"kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n\") pod \"kas-connection-checker-685895c7c9-hxlmq\" (UID: \"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2\") " pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:20.383979 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.383963    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsdg\" (UniqueName: \"kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg\") pod \"kas-connection-checker-685895c7c9-2g88s\" (UID: \"dab5c412-1558-4d16-88c2-0b3f3dd21790\") " pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:20.384872 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.384856    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbwh\" (UniqueName: \"kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh\") pod \"kas-connection-checker-685895c7c9-gkprk\" (UID: \"f5bb4192-b645-4e9e-8f49-1d1e546092aa\") " pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:20.459774 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.459747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmsr\" (UniqueName: \"kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.459955 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.459939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6b7\" (UniqueName: \"kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.460091 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.460203 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.460309 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.460439 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqw5\" (UniqueName: \"kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5\") pod \"volume-data-source-validator-58c9f5f46d-2wmxc\" (UID: \"5869efa1-9154-450e-a09b-710f9a51dcfc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:20.460556 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6pw\" (UniqueName: \"kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.460678 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnws7\" (UniqueName: \"kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.460765 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.460861 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.460955 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.460943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssb2n\" (UniqueName: \"kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.461092 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.461223 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.461345 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.461458 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.461622 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.461766 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hx7\" (UniqueName: \"kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.461889 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.461872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.462052 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.462171 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.462298 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crpb8\" (UniqueName: \"kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.462414 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462398    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.462520 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462506    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.462668 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.462653    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwn9z\" (UniqueName: \"kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z\") pod \"network-check-source-6f78d59f99-q25gd\" (UID: \"21c64927-d977-4fa0-88fe-27c90b7dc9fc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:20.463155 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.463129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:20.463243 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.463150    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:20.463296 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.463272    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.963245084 +0000 UTC m=+30.627846926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:20.463686 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.463666    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:20.463874 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.463845    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.963826609 +0000 UTC m=+30.628428449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:20.464005 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.463963    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:20.464085 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.464056    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:20.96403022 +0000 UTC m=+30.628632045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:20.464085 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.463847    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.464559 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.464283    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.465493 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.465451    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.465938 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.465726    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.465938 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.465736    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.465938 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.465757    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.465938 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.465884    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.466186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.466021    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.466186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.466029    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.466186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.466062    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.466186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.466118    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.466649 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.466628    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.473725 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.473708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:20.478671 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.478649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:20.490132 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.490104    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmsr\" (UniqueName: \"kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.492980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.492494    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnws7\" (UniqueName: \"kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.492980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.492755    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crpb8\" (UniqueName: \"kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.492980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.492934    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwn9z\" (UniqueName: \"kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z\") pod \"network-check-source-6f78d59f99-q25gd\" (UID: \"21c64927-d977-4fa0-88fe-27c90b7dc9fc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:20.493299 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.493276    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hx7\" (UniqueName: \"kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.493519 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.493491    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssb2n\" (UniqueName: \"kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.494719 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.494685    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6b7\" (UniqueName: \"kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.494913 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.494888    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqw5\" (UniqueName: \"kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5\") pod \"volume-data-source-validator-58c9f5f46d-2wmxc\" (UID: \"5869efa1-9154-450e-a09b-710f9a51dcfc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:20.496071 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.496047    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6pw\" (UniqueName: \"kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.503566 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.503543    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:20.533990 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.533697    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:20.540782 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.539899    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:20.547051 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.546150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:20.558850 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.558826    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:20.573299 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.573182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:20.580660 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.580476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:20.782907 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.782881    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gkprk"]
Oct 30 02:55:20.785956 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.785930    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bb4192_b645_4e9e_8f49_1d1e546092aa.slice/crio-7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793 WatchSource:0}: Error finding container 7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793: Status 404 returned error can't find the container with id 7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793
Oct 30 02:55:20.788609 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.788563    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2g88s"]
Oct 30 02:55:20.791478 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.791451    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab5c412_1558_4d16_88c2_0b3f3dd21790.slice/crio-c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a WatchSource:0}: Error finding container c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a: Status 404 returned error can't find the container with id c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a
Oct 30 02:55:20.827194 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.827171    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hxlmq"]
Oct 30 02:55:20.843846 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.843824    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-nf7zn"]
Oct 30 02:55:20.848019 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.847364    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode243aa8e_a8a4_4e4c_9a45_d9929f315b73.slice/crio-53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454 WatchSource:0}: Error finding container 53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454: Status 404 returned error can't find the container with id 53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454
Oct 30 02:55:20.868092 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.868034    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.868212 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.868093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:20.868212 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.868170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:20.868212 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868194    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.868237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868262    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.868243273 +0000 UTC m=+31.532845117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868320    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868332    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.868339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:20.868371 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868373    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.868357446 +0000 UTC m=+31.532959271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:20.868720 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868376    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:20.868720 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868388    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:20.868720 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868425    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.868413459 +0000 UTC m=+31.533015287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:20.868720 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868437    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.868430667 +0000 UTC m=+31.533032492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:20.868720 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868449    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:20.868985 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.868906    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.868896285 +0000 UTC m=+31.533498147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:20.911089 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.911027    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"]
Oct 30 02:55:20.920762 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.920737    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-54724"]
Oct 30 02:55:20.921501 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.921473    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefeb4c3_553f_4427_836a_72b5f1bbc0d4.slice/crio-ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc WatchSource:0}: Error finding container ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc: Status 404 returned error can't find the container with id ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc
Oct 30 02:55:20.935549 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.933910    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"]
Oct 30 02:55:20.937916 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.936058    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd6aa53_869a_4820_beb5_dd8a2d819fda.slice/crio-200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0 WatchSource:0}: Error finding container 200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0: Status 404 returned error can't find the container with id 200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0
Oct 30 02:55:20.944422 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.943434    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421331b3_cfe2_4595_932a_1e40125ab04a.slice/crio-36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25 WatchSource:0}: Error finding container 36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25: Status 404 returned error can't find the container with id 36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25
Oct 30 02:55:20.945216 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.945195    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ndt7q"]
Oct 30 02:55:20.949178 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.949140    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb3501b_daca_440a_8791_b3e41b7128e1.slice/crio-c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb WatchSource:0}: Error finding container c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb: Status 404 returned error can't find the container with id c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb
Oct 30 02:55:20.966990 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.966142    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"]
Oct 30 02:55:20.966990 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.966304    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"]
Oct 30 02:55:20.967667 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.967296    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5869efa1_9154_450e_a09b_710f9a51dcfc.slice/crio-d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6 WatchSource:0}: Error finding container d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6: Status 404 returned error can't find the container with id d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6
Oct 30 02:55:20.969882 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.969856    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:20.969939 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.969902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:20.970084 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:20.970004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970220    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970277    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.970259466 +0000 UTC m=+31.634861306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970359    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970400    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.970388184 +0000 UTC m=+31.634990026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970409    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:20.970718 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:20.970466    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:21.970448189 +0000 UTC m=+31.635050029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:20.972138 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:20.971145    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c64927_d977_4fa0_88fe_27c90b7dc9fc.slice/crio-27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388 WatchSource:0}: Error finding container 27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388: Status 404 returned error can't find the container with id 27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388
Oct 30 02:55:21.109796 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.109762    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd" event={"ID":"21c64927-d977-4fa0-88fe-27c90b7dc9fc","Type":"ContainerStarted","Data":"27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388"}
Oct 30 02:55:21.111060 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.111038    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj" event={"ID":"421331b3-cfe2-4595-932a-1e40125ab04a","Type":"ContainerStarted","Data":"36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25"}
Oct 30 02:55:21.112174 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.112156    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-nf7zn" event={"ID":"e243aa8e-a8a4-4e4c-9a45-d9929f315b73","Type":"ContainerStarted","Data":"53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454"}
Oct 30 02:55:21.113634 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.113610    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-hxlmq" event={"ID":"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2","Type":"ContainerStarted","Data":"324404420f5e279333d7ccf2a5132ee1732d1b0002197073a456fb613e220393"}
Oct 30 02:55:21.113715 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.113647    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-hxlmq" event={"ID":"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2","Type":"ContainerStarted","Data":"d593dab9e58c5771378e8bfd016c7a9b5bf3993ab39e3b98cd079b36304eb88d"}
Oct 30 02:55:21.114778 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.114757    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72" event={"ID":"defeb4c3-553f-4427-836a-72b5f1bbc0d4","Type":"ContainerStarted","Data":"ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc"}
Oct 30 02:55:21.115903 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.115883    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ndt7q" event={"ID":"8cb3501b-daca-440a-8791-b3e41b7128e1","Type":"ContainerStarted","Data":"c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb"}
Oct 30 02:55:21.116980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.116956    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc" event={"ID":"5869efa1-9154-450e-a09b-710f9a51dcfc","Type":"ContainerStarted","Data":"d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6"}
Oct 30 02:55:21.118329 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.118270    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gkprk" event={"ID":"f5bb4192-b645-4e9e-8f49-1d1e546092aa","Type":"ContainerStarted","Data":"586daa8ef60a98c7b7f3fbe2a05c2989085c52f1d09868e86ac6be0e037aee8d"}
Oct 30 02:55:21.118329 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.118317    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gkprk" event={"ID":"f5bb4192-b645-4e9e-8f49-1d1e546092aa","Type":"ContainerStarted","Data":"7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793"}
Oct 30 02:55:21.119493 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.119475    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" event={"ID":"7cd6aa53-869a-4820-beb5-dd8a2d819fda","Type":"ContainerStarted","Data":"200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0"}
Oct 30 02:55:21.120956 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.120935    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2g88s" event={"ID":"dab5c412-1558-4d16-88c2-0b3f3dd21790","Type":"ContainerStarted","Data":"ea6848a3acde90f03eba0a565459a3a0bb732b3d87ce4181204353c166ff7515"}
Oct 30 02:55:21.121040 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.120971    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2g88s" event={"ID":"dab5c412-1558-4d16-88c2-0b3f3dd21790","Type":"ContainerStarted","Data":"c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a"}
Oct 30 02:55:21.151343 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.151302    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-hxlmq" podStartSLOduration=366.151290602 podStartE2EDuration="6m6.151290602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:21.15094088 +0000 UTC m=+30.815542727" watchObservedRunningTime="2026-10-30 02:55:21.151290602 +0000 UTC m=+30.815892449"
Oct 30 02:55:21.189782 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.189739    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-2g88s" podStartSLOduration=366.189728185 podStartE2EDuration="6m6.189728185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:21.188904332 +0000 UTC m=+30.853506200" watchObservedRunningTime="2026-10-30 02:55:21.189728185 +0000 UTC m=+30.854330051"
Oct 30 02:55:21.228186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.228145    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-gkprk" podStartSLOduration=366.228129707 podStartE2EDuration="6m6.228129707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:21.227514355 +0000 UTC m=+30.892116186" watchObservedRunningTime="2026-10-30 02:55:21.228129707 +0000 UTC m=+30.892731555"
Oct 30 02:55:21.829870 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.829026    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:21.829870 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.829515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:21.831942 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.830539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:21.844940 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.844453    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzrlw\""
Oct 30 02:55:21.844940 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.844522    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:55:21.844940 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.844670    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-kdtjd\""
Oct 30 02:55:21.844940 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.844833    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bckpk\""
Oct 30 02:55:21.844940 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.844915    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:55:21.878195 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.878167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:21.878292 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.878233    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:21.878356 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.878297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:21.878356 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.878350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:21.878433 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.878406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:21.878637 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878618    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:21.878879 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878763    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:21.878879 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878779    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:21.878879 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878785    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:21.879076 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878883    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:21.879076 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.878895    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:21.879648 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.879297    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.879272832 +0000 UTC m=+33.543874673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:21.879648 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.879323    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.879312724 +0000 UTC m=+33.543914554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:21.879648 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.879341    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.879332514 +0000 UTC m=+33.543934342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:21.879648 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.879358    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.879350458 +0000 UTC m=+33.543952286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:21.879648 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.879373    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.87936587 +0000 UTC m=+33.543967708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:21.979698 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.979663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:21.979900 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.979711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:21.979900 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:21.979801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:21.980021 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.979946    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:21.980021 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.980012    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.979984825 +0000 UTC m=+33.644586652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:21.980675 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.980647    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:21.980775 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.980692    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.980682247 +0000 UTC m=+33.645284073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:21.980775 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.980755    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:21.980850 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:21.980788    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:23.980776709 +0000 UTC m=+33.645378536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:23.902207 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:23.902116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:23.902229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:23.902302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:23.902368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902407    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902433    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902474    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.902450666 +0000 UTC m=+37.567052508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902481    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902503    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:23.902526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902538    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.902526837 +0000 UTC m=+37.567128692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902480    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902566    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.902550444 +0000 UTC m=+37.567152284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902611    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.90259275 +0000 UTC m=+37.567194593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902617    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:23.902814 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:23.902640    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.902633797 +0000 UTC m=+37.567235660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:24.004031 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.003990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:24.004183 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.004038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:24.004183 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.004121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:24.004349 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004334    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:24.004469 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004394    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:28.004377523 +0000 UTC m=+37.668979368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:24.004469 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004455    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:24.004617 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004489    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:28.004477732 +0000 UTC m=+37.669079574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:24.004617 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004541    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:24.004617 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.004568    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:28.004558667 +0000 UTC m=+37.669160506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:24.138186 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.138146    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc" event={"ID":"5869efa1-9154-450e-a09b-710f9a51dcfc","Type":"ContainerStarted","Data":"a348ae0944d483ad942b240dad3b3efd8bebf770a0aa3a1be2392750cb4583a2"}
Oct 30 02:55:24.178843 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.178614    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc" podStartSLOduration=316.84797485 podStartE2EDuration="5m19.178595705s" totalImagesPullingTime="2.330620855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:24.176744715 +0000 UTC m=+33.841346565" watchObservedRunningTime="2026-10-30 02:55:24.178595705 +0000 UTC m=+33.843197554"
Oct 30 02:55:24.611653 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.611612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:24.611831 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.611801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:24.611972 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.611957    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:24.612037 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:24.612027    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:56.612006677 +0000 UTC m=+66.276608509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : secret "metrics-daemon-secret" not found
Oct 30 02:55:24.619772 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.619705    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:24.712339 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.712296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:24.716191 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.716158    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:24.900399 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.900146    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:24.918421 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:24.918259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:25.216503 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:25.216468    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l6fz8"]
Oct 30 02:55:25.243393 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:25.243363    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd7fb7e_4ce4_44ec_8d4d_d4c753f8591a.slice/crio-4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd WatchSource:0}: Error finding container 4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd: Status 404 returned error can't find the container with id 4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd
Oct 30 02:55:25.861829 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:25.861717    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmgzm"]
Oct 30 02:55:25.984161 ip-10-0-136-202 kubenswrapper[2584]: W1030 02:55:25.984134    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f88cfca_1150_49ac_812b_2b77442e467b.slice/crio-b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0 WatchSource:0}: Error finding container b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0: Status 404 returned error can't find the container with id b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0
Oct 30 02:55:26.146687 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.146567    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-nf7zn" event={"ID":"e243aa8e-a8a4-4e4c-9a45-d9929f315b73","Type":"ContainerStarted","Data":"7da108e137ba2c9965b6525ae2fc6cebe5911b82fdd76033903928550c8203c2"}
Oct 30 02:55:26.148409 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.148378    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72" event={"ID":"defeb4c3-553f-4427-836a-72b5f1bbc0d4","Type":"ContainerStarted","Data":"d82f74f2ce65f1c6f7c213ad8d57bfbd91a777d6091567571aa84e2d021be66e"}
Oct 30 02:55:26.150401 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.150373    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l6fz8" event={"ID":"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a","Type":"ContainerStarted","Data":"4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd"}
Oct 30 02:55:26.152781 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.152758    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/0.log"
Oct 30 02:55:26.152882 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.152800    2584 generic.go:356] "Generic (PLEG): container finished" podID="7cd6aa53-869a-4820-beb5-dd8a2d819fda" containerID="b59b6c3c8ae05223cbf2a37c67e727dfa7c4585169a960be994c0e3da1693a87" exitCode=255
Oct 30 02:55:26.152882 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.152876    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" event={"ID":"7cd6aa53-869a-4820-beb5-dd8a2d819fda","Type":"ContainerDied","Data":"b59b6c3c8ae05223cbf2a37c67e727dfa7c4585169a960be994c0e3da1693a87"}
Oct 30 02:55:26.153100 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.153081    2584 scope.go:122] "RemoveContainer" containerID="b59b6c3c8ae05223cbf2a37c67e727dfa7c4585169a960be994c0e3da1693a87"
Oct 30 02:55:26.154180 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.154157    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmgzm" event={"ID":"6f88cfca-1150-49ac-812b-2b77442e467b","Type":"ContainerStarted","Data":"b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0"}
Oct 30 02:55:26.186849 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.186802    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-nf7zn" podStartSLOduration=320.474703561 podStartE2EDuration="5m25.18678539s" totalImagesPullingTime="4.712081829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:26.186537826 +0000 UTC m=+35.851139677" watchObservedRunningTime="2026-10-30 02:55:26.18678539 +0000 UTC m=+35.851387238"
Oct 30 02:55:26.232605 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.232073    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72" podStartSLOduration=316.60223189 podStartE2EDuration="5m21.23205436s" totalImagesPullingTime="4.62982247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:26.230473071 +0000 UTC m=+35.895074919" watchObservedRunningTime="2026-10-30 02:55:26.23205436 +0000 UTC m=+35.896656207"
Oct 30 02:55:26.517614 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.517181    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qts9q"]
Oct 30 02:55:26.543957 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.543771    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qts9q"]
Oct 30 02:55:26.543957 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.543904    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.622288 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.616773    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:55:26.634631 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.634603    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.634749 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.634656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th92m\" (UniqueName: \"kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.634749 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.634686    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.634749 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.634720    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.635012 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.634772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.635061 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.635044    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:55:26.635938 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.635916    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d8b4w\""
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th92m\" (UniqueName: \"kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:26.736430    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:26.736490    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.236472293 +0000 UTC m=+36.901074134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.736979    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.737383    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:26.737473    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:26.737553 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:26.737519    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:27.237504318 +0000 UTC m=+36.902106144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:26.769123 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:26.769075    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th92m\" (UniqueName: \"kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:27.159702 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.159619    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd" event={"ID":"21c64927-d977-4fa0-88fe-27c90b7dc9fc","Type":"ContainerStarted","Data":"4775ae6eafa27386137d8a979250777f90891ca510a0e25d6924b6facf1e9124"}
Oct 30 02:55:27.161290 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.161237    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj" event={"ID":"421331b3-cfe2-4595-932a-1e40125ab04a","Type":"ContainerStarted","Data":"025c7038ef3a3b5a75f9ed6252b2d0e35d6ae8750216852200bbdf0f6d8aea3c"}
Oct 30 02:55:27.162980 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.162946    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ndt7q" event={"ID":"8cb3501b-daca-440a-8791-b3e41b7128e1","Type":"ContainerStarted","Data":"de4a4d2bd021b2bd25185e15dee16565285c1aaddfc4e999b9414354cf62bfea"}
Oct 30 02:55:27.164773 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.164747    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:27.165161 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.165142    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/0.log"
Oct 30 02:55:27.165239 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.165179    2584 generic.go:356] "Generic (PLEG): container finished" podID="7cd6aa53-869a-4820-beb5-dd8a2d819fda" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd" exitCode=255
Oct 30 02:55:27.165309 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.165264    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" event={"ID":"7cd6aa53-869a-4820-beb5-dd8a2d819fda","Type":"ContainerDied","Data":"2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"}
Oct 30 02:55:27.165362 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.165321    2584 scope.go:122] "RemoveContainer" containerID="b59b6c3c8ae05223cbf2a37c67e727dfa7c4585169a960be994c0e3da1693a87"
Oct 30 02:55:27.165491 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.165473    2584 scope.go:122] "RemoveContainer" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"
Oct 30 02:55:27.165704 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.165683    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:27.168790 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.168769    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmgzm" event={"ID":"6f88cfca-1150-49ac-812b-2b77442e467b","Type":"ContainerStarted","Data":"3d303025f48116cf865bef8376f7a8623a56e33035cd0cde369d48877f5953ef"}
Oct 30 02:55:27.168942 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.168828    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:27.214503 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.214450    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd" podStartSLOduration=316.770831356 podStartE2EDuration="5m22.214433187s" totalImagesPullingTime="5.443601831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:27.212908397 +0000 UTC m=+36.877510271" watchObservedRunningTime="2026-10-30 02:55:27.214433187 +0000 UTC m=+36.879035034"
Oct 30 02:55:27.241637 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.241596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:27.241847 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.241824    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:27.241928 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.241900    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:28.241879878 +0000 UTC m=+37.906481717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:27.242260 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.242232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:27.243145 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.242951    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:27.243145 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.243008    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:28.242991695 +0000 UTC m=+37.907593527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:27.268390 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.268329    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ndt7q" podStartSLOduration=1.827388937 podStartE2EDuration="7.26831455s" totalImagesPullingTime="5.440925613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:27.2682885 +0000 UTC m=+36.932890348" watchObservedRunningTime="2026-10-30 02:55:27.26831455 +0000 UTC m=+36.932916390"
Oct 30 02:55:27.351569 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.351520    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj" podStartSLOduration=316.902614994 podStartE2EDuration="5m22.351507635s" totalImagesPullingTime="5.448892641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:27.350435586 +0000 UTC m=+37.015037435" watchObservedRunningTime="2026-10-30 02:55:27.351507635 +0000 UTC m=+37.016109461"
Oct 30 02:55:27.389701 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.389649    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qmgzm" podStartSLOduration=35.832010731 podStartE2EDuration="36.389630588s" totalImagesPullingTime="557.619857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:27.38837595 +0000 UTC m=+37.052977799" watchObservedRunningTime="2026-10-30 02:55:27.389630588 +0000 UTC m=+37.054232437"
Oct 30 02:55:27.949760 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.949723    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:27.949935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.949778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:27.949935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.949825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:27.949935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.949859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:27.949935 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949883    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:27.949935 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:27.949912    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949956    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.949937386 +0000 UTC m=+45.614539212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949886    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949987    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.950003    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949988    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.949987    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.950027    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.950013273 +0000 UTC m=+45.614615118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.950095    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.950081012 +0000 UTC m=+45.614682838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.950115    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.950102941 +0000 UTC m=+45.614704788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:27.950175 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:27.950133    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.950122818 +0000 UTC m=+45.614724650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:28.050485 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.050458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:28.050653 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.050492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:28.050653 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.050553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:28.050653 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050619    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:28.050803 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050672    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:36.05065699 +0000 UTC m=+45.715258817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:28.050803 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050698    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:28.050803 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050728    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:28.050803 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050755    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:36.050739446 +0000 UTC m=+45.715341272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:28.050803 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.050777    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:36.050765817 +0000 UTC m=+45.715367645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:28.175329 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.175305    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:28.176339 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.175844    2584 scope.go:122] "RemoveContainer" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"
Oct 30 02:55:28.176339 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.176083    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.252708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:28.252785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.252920    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.253017    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:30.252949545 +0000 UTC m=+39.917551372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.253019    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:28.253286 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:28.253183    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:30.253166465 +0000 UTC m=+39.917768313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:30.274395 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:30.274363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:30.274859 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:30.274409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:30.274859 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:30.274503    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:30.274859 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:30.274552    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:30.274859 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:30.274570    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:34.274554204 +0000 UTC m=+43.939156046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:30.274859 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:30.274612    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:34.274600485 +0000 UTC m=+43.939202316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:30.560088 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:30.560018    2584 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:30.560204 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:30.560117    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:30.560493 ip-10-0-136-202 kubenswrapper[2584]: I1030 02:55:30.560479    2584 scope.go:122] "RemoveContainer" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"
Oct 30 02:55:30.560722 ip-10-0-136-202 kubenswrapper[2584]: E1030 02:55:30.560700    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:30.616437 ip-10-0-136-202 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 02:55:30.634027 ip-10-0-136-202 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 02:55:30.634244 ip-10-0-136-202 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 02:55:30.634303 ip-10-0-136-202 systemd[1]: kubelet.service: Consumed 2.774s CPU time.
Oct 30 02:55:30.649015 ip-10-0-136-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:55:30.739089 ip-10-0-136-202 kubenswrapper[4869]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:30.739089 ip-10-0-136-202 kubenswrapper[4869]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:55:30.739089 ip-10-0-136-202 kubenswrapper[4869]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:30.739425 ip-10-0-136-202 kubenswrapper[4869]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:30.741154 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741086    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.741154 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741153    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741158    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741161    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741164    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741167    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741170    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741172    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741176    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741181    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741185    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741188    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741191    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741194    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741196    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741199    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741202    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741205    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741208    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741210    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.741228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741214    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741217    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741219    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741222    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741225    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741227    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741230    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741235    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741239    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741242    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741245    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741248    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741251    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741253    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741256    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741258    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741261    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741263    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741266    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741268    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.741747 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741271    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741273    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741276    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741278    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741281    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741284    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741286    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741289    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741291    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741294    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741296    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741299    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741302    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741305    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741308    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741311    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741313    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741316    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741319    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.742255 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741321    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741324    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741327    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741329    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741332    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741334    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741338    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741341    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741343    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741346    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741349    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741361    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741364    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741367    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741371    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741373    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741376    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741379    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741381    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.742746 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741384    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741387    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741389    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741392    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741394    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741397    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741399    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741402    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741405    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741408    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741411    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741413    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741416    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741418    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741421    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741423    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741426    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741429    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741431    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741434    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.743225 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741437    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741439    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741442    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741447    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741449    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741452    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741455    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.741458    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742251    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742258    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742262    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742265    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742268    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742271    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742273    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742276    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742280    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742282    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742285    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742287    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.743756 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742293    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742296    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742298    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742301    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742303    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742306    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742308    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742311    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742314    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742316    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742319    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742322    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742324    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742327    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742330    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742333    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742336    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742339    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742342    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742344    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.744562 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742348    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742351    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742354    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742357    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742360    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742363    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742365    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742368    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742371    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742373    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742376    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742379    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742382    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742385    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742387    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742390    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742392    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742399    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742403    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.745097 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742406    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742410    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742413    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742416    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742418    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742421    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742424    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742427    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742429    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742432    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742435    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742437    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742440    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742443    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742445    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742448    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742450    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742453    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742456    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742458    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.745569 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742461    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742463    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742466    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742468    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742471    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742474    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742477    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742479    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742482    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742485    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742489    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742492    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742494    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742497    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742500    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742502    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742505    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742508    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742510    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742513    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.746134 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742516    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742518    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742521    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742523    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742526    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742529    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742532    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742535    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742537    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742540    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742542    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742545    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742548    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742550    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.742553    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743023    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743030    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743035    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743038    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743041    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.746679 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743044    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743047    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743050    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743053    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743056    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743059    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743061    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743064    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743067    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743071    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743074    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743077    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743081    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743083    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743086    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743088    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743091    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743093    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.747188 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743096    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743101    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743105    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743107    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743110    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743113    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743115    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743118    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743121    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743124    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743126    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743130    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743133    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743135    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743138    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743140    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743143    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743145    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743148    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.747989 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743150    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743153    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743155    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743158    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743160    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743163    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743165    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743168    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743172    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743174    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743177    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743179    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743182    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743184    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743187    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743189    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743192    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743194    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743197    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743199    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.748557 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743202    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743204    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743207    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743209    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743214    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743217    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743219    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743222    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743224    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743227    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743230    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743233    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743235    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743238    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743240    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743243    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743246    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743248    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743251    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.749085 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743254    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743256    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743259    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743262    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743264    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743267    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743269    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743272    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743274    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743277    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743279    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743282    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743284    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743287    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743289    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743292    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743296    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743300    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743302    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743305    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.749600 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743308    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743310    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743313    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743315    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.743318    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743415    4869 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743427    4869 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743435    4869 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743440    4869 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743445    4869 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743448    4869 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743453    4869 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743457    4869 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743460    4869 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743463    4869 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743467    4869 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743470    4869 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743474    4869 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743477    4869 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743480    4869 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743483    4869 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743486    4869 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743488    4869 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:55:30.750090 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743493    4869 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743496    4869 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743499    4869 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743509    4869 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743514    4869 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743519    4869 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743523    4869 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743526    4869 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743530    4869 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743533    4869 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743536    4869 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743539    4869 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743542    4869 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743545    4869 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743550    4869 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743554    4869 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743557    4869 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743560    4869 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743563    4869 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743566    4869 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743570    4869 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743573    4869 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743590    4869 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743595    4869 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:55:30.750675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743599    4869 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743606    4869 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743611    4869 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743616    4869 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743619    4869 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743623    4869 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743626    4869 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743629    4869 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743631    4869 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743634    4869 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743637    4869 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743641    4869 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743644    4869 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743647    4869 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743652    4869 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743655    4869 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743659    4869 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743662    4869 flags.go:64] FLAG: --help="false"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743665    4869 flags.go:64] FLAG: --hostname-override="ip-10-0-136-202.ec2.internal"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743668    4869 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743671    4869 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743674    4869 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743678    4869 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:55:30.751287 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743682    4869 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743685    4869 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743688    4869 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743691    4869 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743694    4869 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743697    4869 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743700    4869 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743703    4869 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743706    4869 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743709    4869 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743712    4869 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743715    4869 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743719    4869 flags.go:64] FLAG: --lock-file=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743722    4869 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743724    4869 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743728    4869 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743733    4869 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743736    4869 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743739    4869 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743742    4869 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743744    4869 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743748    4869 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743750    4869 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743754    4869 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743759    4869 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:55:30.752091 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743762    4869 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743766    4869 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743769    4869 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743772    4869 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743775    4869 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743778    4869 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743781    4869 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743786    4869 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743789    4869 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743796    4869 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743799    4869 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743802    4869 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743805    4869 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743807    4869 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743810    4869 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743813    4869 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743816    4869 flags.go:64] FLAG: --port="10250"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743819    4869 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743822    4869 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aed9899c808d1065"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743826    4869 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743829    4869 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743832    4869 flags.go:64] FLAG: --register-node="true"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743835    4869 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743852    4869 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743855    4869 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743858    4869 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:55:30.752728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743861    4869 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743865    4869 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743868    4869 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743871    4869 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743875    4869 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743878    4869 flags.go:64] FLAG: --runonce="false"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743881    4869 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743884    4869 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743887    4869 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743890    4869 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743893    4869 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743896    4869 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743899    4869 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743903    4869 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743906    4869 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743909    4869 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743912    4869 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743915    4869 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743918    4869 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743921    4869 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743924    4869 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743929    4869 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743932    4869 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743935    4869 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743939    4869 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:55:30.753403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743942    4869 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743945    4869 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743948    4869 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743951    4869 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743954    4869 flags.go:64] FLAG: --v="2"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743958    4869 flags.go:64] FLAG: --version="false"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743962    4869 flags.go:64] FLAG: --vmodule=""
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743966    4869 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.743969    4869 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744094    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744098    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744102    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744104    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744108    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744111    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744113    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744116    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744119    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744121    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744124    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744128    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.754209 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744131    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744134    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744139    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744142    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744145    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744148    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744150    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744153    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744156    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744158    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744161    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744164    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744166    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744169    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744172    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744175    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744178    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744181    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744184    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.755025 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744187    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744189    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744192    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744196    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744200    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744203    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744207    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744210    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744214    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744217    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744219    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744222    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744226    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744229    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744232    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744235    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744237    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744240    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744243    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.755595 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744245    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744248    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744250    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744253    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744256    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744259    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744261    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744264    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744269    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744272    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744275    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744277    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744280    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744282    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744285    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744288    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744290    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744293    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744295    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744298    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.756080 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744300    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744303    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744306    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744308    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744311    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744315    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744317    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744320    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744323    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744325    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744328    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744330    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744333    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744336    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744338    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744341    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744344    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744346    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744349    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744352    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.756740 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744355    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744358    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744360    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744363    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744367    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744369    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744372    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744375    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744377    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744380    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744382    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744385    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744388    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744390    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744393    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744395    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.757363 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.744421    4869 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744455    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744461    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744464    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744467    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744469    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744472    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744475    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744477    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744480    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744483    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744485    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744488    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744490    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744493    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744495    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744498    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744501    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744504    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744507    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.757856 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744511    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744514    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744516    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744519    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744522    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744525    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744527    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744530    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744532    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744535    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744537    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744540    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744542    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744545    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744548    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744551    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744554    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744557    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744560    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.765121 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744562    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744565    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744568    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744570    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744573    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744589    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744594    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744598    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744602    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744606    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744610    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744614    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744617    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744621    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744624    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744626    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744629    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744631    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744634    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744637    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.765868 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744640    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744642    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744645    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744647    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744650    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744653    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744656    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744659    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744662    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744665    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744667    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744670    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744672    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744676    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744680    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744683    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744685    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744688    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744691    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.766376 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744693    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744696    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744698    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744701    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744703    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744706    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744710    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744713    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744715    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744718    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744722    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744725    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744727    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744730    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744732    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744736    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744740    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744743    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744746    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.766907 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744748    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744752    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744755    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744757    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744760    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744763    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744765    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744768    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744772    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.744774    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.749241    4869 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.749256    4869 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.749279    4869 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.749284    4869 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749342    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749347    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749350    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749354    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749356    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749359    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.767403 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749362    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749364    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749367    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749370    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749372    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749375    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749378    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749380    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749383    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749386    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749388    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749391    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749395    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749400    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749404    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749408    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749412    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749415    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749418    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749422    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.767931 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749426    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749433    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749437    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749440    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749442    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749445    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749448    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749451    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749454    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749456    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749459    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749462    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749465    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749468    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749470    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749473    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749476    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749478    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749481    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.768417 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749484    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749486    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749490    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749492    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749495    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749498    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749500    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749503    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749505    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749508    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749510    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749513    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749516    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749519    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749522    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749524    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749527    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749529    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749532    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749552    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.768941 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749557    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749560    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749563    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749566    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749568    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749572    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749591    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749596    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749599    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749602    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749606    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749609    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749612    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749615    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749618    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749621    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749624    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749626    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749629    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.769464 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749631    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749634    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749636    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749639    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749642    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749644    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749647    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749656    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749660    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749663    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749666    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749668    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749671    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749673    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749676    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749678    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749681    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749684    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749687    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.770284 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749689    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749692    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749695    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.749722    4869 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749855    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749862    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749865    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749868    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749871    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749874    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749877    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749880    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749882    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749885    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749887    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.771172 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749890    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749893    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749896    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749899    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749901    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749904    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749906    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749909    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749911    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749914    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749916    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749919    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749921    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749924    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749926    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749929    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749931    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749934    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749937    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.771857 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749939    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749942    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749945    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749947    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749950    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749953    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749955    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749958    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749961    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749964    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749966    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749969    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749972    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749976    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749980    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749983    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749986    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749990    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749992    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.772703 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749995    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.749998    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750001    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750003    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750006    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750008    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750011    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750013    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750016    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750018    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750021    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750024    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750026    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750029    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750031    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750034    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750036    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750039    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750041    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750044    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750046    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.773489 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750049    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750052    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750054    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750057    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750060    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750062    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750065    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750067    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750070    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750072    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750076    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750080    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750083    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750086    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750088    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750091    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750094    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750096    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750099    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.774391 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750102    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750105    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750107    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750110    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750112    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750115    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750117    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750123    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750125    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750128    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750130    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750133    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750135    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750138    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750140    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750147    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.775017 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750150    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.750173    4869 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750204    4869 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750208    4869 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750211    4869 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750214    4869 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750217    4869 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750219    4869 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750222    4869 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750224    4869 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750227    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750230    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750232    4869 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750235    4869 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750237    4869 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:30.775442 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750240    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750244    4869 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750248    4869 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750250    4869 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750253    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750256    4869 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750259    4869 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750262    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750266    4869 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750268    4869 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750271    4869 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750275    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750278    4869 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750280    4869 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750283    4869 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750285    4869 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750288    4869 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750291    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750294    4869 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750296    4869 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:30.775840 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750299    4869 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750301    4869 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750304    4869 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750307    4869 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750309    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750312    4869 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750314    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750317    4869 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750319    4869 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750322    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750325    4869 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750327    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750330    4869 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750332    4869 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750335    4869 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750338    4869 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750340    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750343    4869 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750346    4869 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750351    4869 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:30.776315 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750355    4869 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750358    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750360    4869 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750364    4869 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750367    4869 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750370    4869 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750373    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750375    4869 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750378    4869 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750380    4869 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750383    4869 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750386    4869 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750389    4869 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750391    4869 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750394    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750397    4869 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750399    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750402    4869 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750404    4869 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750407    4869 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:30.776864 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750410    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750413    4869 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750415    4869 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750418    4869 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750420    4869 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750423    4869 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750426    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750429    4869 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750431    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750434    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750436    4869 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750439    4869 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750443    4869 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750445    4869 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750448    4869 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750452    4869 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750454    4869 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750457    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:30.777563 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750461    4869 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750463    4869 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750466    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750468    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750471    4869 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750474    4869 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750477    4869 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750479    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750482    4869 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750484    4869 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750487    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750490    4869 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750492    4869 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750495    4869 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:30.750497    4869 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.750548    4869 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751470    4869 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751530    4869 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751721    4869 server.go:1014] "Starting client certificate rotation"
Oct 30 02:55:30.778455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751861    4869 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:55:30.777634 ip-10-0-136-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751915    4869 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:49:50 +0000 UTC" deadline="2028-07-07 07:30:56.069598434 +0000 UTC"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.751943    4869 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14788h35m25.317657689s"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.752133    4869 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.753112    4869 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.754557    4869 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.756373    4869 log.go:25] "Validated CRI v1 image API"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.757222    4869 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:55:30.779662 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.759054    4869 fs.go:135] Filesystem UUIDs: map[040c31cd-dcdd-4c4e-9d57-dbce2c407838:/dev/nvme0n1p4 5a3d83e3-3e26-44eb-a75b-8de59dc54219:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 02:55:30.780038 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.759073    4869 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc/userdata/shm major:0 minor:73 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a/userdata/shm major:0 minor:221 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d593dab9e58c5771378e8bfd016c7a9b5bf3993ab39e3b98cd079b36304eb88d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d593dab9e58c5771378e8bfd016c7a9b5bf3993ab39e3b98cd079b36304eb88d/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/da4a70f6bf3e5ef023af359abba9486ecfcb02302d3ea935666fa3278b1231da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/da4a70f6bf3e5ef023af359abba9486ecfcb02302d3ea935666fa3278b1231da/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18b6b191-b504-4b31-add7-fdc98bea9aec/volumes/kubernetes.io~projected/kube-api-access-h2lmb:{mountpoint:/var/lib/kubelet/pods/18b6b191-b504-4b31-add7-fdc98bea9aec/volumes/kubernetes.io~projected/kube-api-access-h2lmb major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~projected/kube-api-access-nsqfr:{mountpoint:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~projected/kube-api-access-nsqfr major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21c64927-d977-4fa0-88fe-27c90b7dc9fc/volumes/kubernetes.io~projected/kube-api-access-rwn9z:{mountpoint:/var/lib/kubelet/pods/21c64927-d977-4fa0-88fe-27c90b7dc9fc/volumes/kubernetes.io~projected/kube-api-access-rwn9z major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28695845-d672-425c-9848-4d6894a5427f/volumes/kubernetes.io~projected/kube-api-access-cnws7:{mountpoint:/var/lib/kubelet/pods/28695845-d672-425c-9848-4d6894a5427f/volumes/kubernetes.io~projected/kube-api-access-cnws7 major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c/volumes/kubernetes.io~projected/kube-api-access-f8kmr:{mountpoint:/var/lib/kubelet/pods/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c/volumes/kubernetes.io~projected/kube-api-access-f8kmr major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~projected/kube-api-access-d44lk:{mountpoint:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~projected/kube-api-access-d44lk major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/stats-auth major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c4d4295-8f60-43ba-bedd-3f62177e646a/volumes/kubernetes.io~projected/kube-api-access-tbb5q:{mountpoint:/var/lib/kubelet/pods/3c4d4295-8f60-43ba-bedd-3f62177e646a/volumes/kubernetes.io~projected/kube-api-access-tbb5q major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~projected/kube-api-access-gcmsr:{mountpoint:/var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~projected/kube-api-access-gcmsr major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~secret/serving-cert major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4767108b-7fd3-45da-9ea7-7f076f96034b/volumes/kubernetes.io~projected/kube-api-access-946v9:{mountpoint:/var/lib/kubelet/pods/4767108b-7fd3-45da-9ea7-7f076f96034b/volumes/kubernetes.io~projected/kube-api-access-946v9 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c594df1-aa1e-497a-b6c2-56f3620ced99/volumes/kubernetes.io~projected/kube-api-access-ssb2n:{mountpoint:/var/lib/kubelet/pods/4c594df1-aa1e-497a-b6c2-56f3620ced99/volumes/kubernetes.io~projected/kube-api-access-ssb2n major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/512891c4-1cba-468a-aafb-0c016eb455c2/volumes/kubernetes.io~projected/kube-api-access-pm9xk:{mountpoint:/var/lib/kubelet/pods/512891c4-1cba-468a-aafb-0c016eb455c2/volumes/kubernetes.io~projected/kube-api-access-pm9xk major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5869efa1-9154-450e-a09b-710f9a51dcfc/volumes/kubernetes.io~projected/kube-api-access-kvqw5:{mountpoint:/var/lib/kubelet/pods/5869efa1-9154-450e-a09b-710f9a51dcfc/volumes/kubernetes.io~projected/kube-api-access-kvqw5 major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f88cfca-1150-49ac-812b-2b77442e467b/volumes/kubernetes.io~projected/kube-api-access-mg4zs:{mountpoint:/var/lib/kubelet/pods/6f88cfca-1150-49ac-812b-2b77442e467b/volumes/kubernetes.io~projected/kube-api-access-mg4zs major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78ec5656-f9f4-4a45-a60f-f31fd5e569b9/volumes/kubernetes.io~projected/kube-api-access-9qzzc:{mountpoint:/var/lib/kubelet/pods/78ec5656-f9f4-4a45-a60f-f31fd5e569b9/volumes/kubernetes.io~projected/kube-api-access-9qzzc major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~projected/kube-api-access-p4hx7:{mountpoint:/var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~projected/kube-api-access-p4hx7 major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~secret/serving-cert major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/kube-api-access-2tjnz:{mountpoint:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/kube-api-access-2tjnz major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8814d09f-6e78-4cb5-9536-16527a4b1d30/volumes/kubernetes.io~projected/kube-api-access-pjxwf:{mountpoint:/var/lib/kubelet/pods/8814d09f-6e78-4cb5-9536-16527a4b1d30/volumes/kubernetes.io~projected/kube-api-access-pjxwf major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~projected/kube-api-access-4k6pw:{mountpoint:/var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~projected/kube-api-access-4k6pw major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~secret/cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93516eb5-fe40-4cd8-9b26-7d1b8b240879/volumes/kubernetes.io~projected/kube-api-access-th92m:{mountpoint:/var/lib/kubelet/pods/93516eb5-fe40-4cd8-9b26-7d1b8b240879/volumes/kubernetes.io~projected/kube-api-access-th92m major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~projected/kube-api-access-hg6kr:{mountpoint:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~projected/kube-api-access-hg6kr major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad3e816f-1810-4e16-9392-f393580c75b3/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/ad3e816f-1810-4e16-9392-f393580c75b3/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bce09833-e763-408f-bd70-4c15801d184b/volumes/kubernetes.io~projected/kube-api-access-xf6b7:{mountpoint:/var/lib/kubelet/pods/bce09833-e763-408f-bd70-4c15801d184b/volumes/kubernetes.io~projected/kube-api-access-xf6b7 major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/kube-api-access-mwrpp:{mountpoint:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/kube-api-access-mwrpp major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2/volumes/kubernetes.io~projected/kube-api-access-cht4n:{mountpoint:/var/lib/kubelet/pods/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2/volumes/kubernetes.io~projected/kube-api-access-cht4n major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dab5c412-1558-4d16-88c2-0b3f3dd21790/volumes/kubernetes.io~projected/kube-api-access-4dsdg:{mountpoint:/var/lib/kubelet/pods/dab5c412-1558-4d16-88c2-0b3f3dd21790/volumes/kubernetes.io~projected/kube-api-access-4dsdg major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~projected/kube-api-access-crpb8:{mountpoint:/var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~projected/kube-api-access-crpb8 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~secret/serving-cert major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~projected/kube-api-access-57cr4:{mountpoint:/var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~projected/kube-api-access-57cr4 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5bb4192-b645-4e9e-8f49-1d1e546092aa/volumes/kubernetes.io~projected/kube-api-access-cvbwh:{mountpoint:/var/lib/kubelet/pods/f5bb4192-b645-4e9e-8f49-1d1e546092aa/volumes/kubernetes.io~projected/kube-api-access-cvbwh major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/5769a4d2974cd31b25c5d1167799240c109749962b9a5d4311368b1bbca38d88/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/9d329f90bbbff9078a9b52a107517fbe6a96465bab29e1f86b75322c81d2ae4a/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/a9efab4612ac65f35d89c9fb5698effc60102a0abe986ee358d6b88f6b6d56cc/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/6dd7569f75edf1f1f79f999c000f17cbb3f468bd14426c6c318ade9e29a0a5d3/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/ab4d329db7b5efbdaf82b2e4fe3d9017a6740fe3bbf80be8d03c42a1eeb2a160/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/64db72516967f1e49bc61d8e7289b6ee92c63fc63bb760ebb159d31b8bd95b18/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/d2f26b655af59b4ee6801e36d9c2834d37472e3151a73382978c2777583ab95b/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/f3e8602facacd76d5efc9f91b76be5600478c1b94e1ad29def1bafead4fa616c/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/f382bce7fe987b597763b088a513f53d70dd3e8e544db41fa3e3563c99e72806/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/b6c4d153832e0a00c52b3141732cb17469a2b1aabf4a6eb0d337c5eeeebcb0a1/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/f970c05ef3d93a692c5b9a1293872118b6ec97db2c16c2fe774f344f98fa5e80/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/9e58506b301fa8ed88e5865e1a0124506e499fbfc41464a4342e7d243c6100f3/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/38a4a15af6d1dcd391894645f90a84b953f93ee1209285ac80df9f7442ee5c5a/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/f34368d0f22d1733716e499bfa08ff02ff52908fac56d9f79f413103695cf134/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/e0d7b386ee9d182fa49b0f58a13ea8ecebeb511a7dbd039f7e5fe31b2d5e7afd/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/1ccfff6d9b7bc44b92a5f28034abfe15b0d4ed99f945e048507a8719cdb465b0/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1d3b5eed00f12a4fef3f3bd2acd02120196d9fed4af9d65a5e13340a4b663771/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/0b48052829eb7e952e1185faa2aaba665988f916fecc843d32212b3b59b81e23/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/69cbf9af5c9a61e4003ce447f468cd4f593a8b9cd12e625e685aecd6d230ab20/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/98e9352eddd18124f6d329d09ff3f487fada7fd2db7193be8f407f53390c67b0/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/8981dfff109e6f12ffdd2ec1914cdaf30838936f335d37b016ddcda10f01f19a/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/be9190cf8a79b6b406741cdb3a8a89b582502118908eaa6a4d7e2d418da9daf6/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/c3ba1eaf9410cb9c763f292c330f02bba99903b3fb2a9ec8d80dc5b2b6b144bc/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/8c100b1cd4a05dc6841329c9b3503eb4ca0e0798fe3c0a4cca37d26e006f2654/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/22350f59b3eaa17ace62f6a04069cf99b671bbb606f0c2d320d6a9da054e6745/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/7d67f99bbfb7f72f8306f85d9acd01ff28834286682be976c954966983b3f1de/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/814033af867d70e1748640ffc0ea5aaa8957e37b46d510864ba271d306ee09cf/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/60773b9c5aa27e67c4f5451e0fc8490555d6e5ea198c39cb5b6cafcd1a958338/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/c598b4aa5f490f4a2d37fbad392a5d9a2bb39219bfc2c9d189def215d3d65c58/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/8f003a576ea3c5f2866593b00fcbbd51f822f9b06eacc0b0f74cc12dfcfd51b4/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/cac8a01fd69d5429ef096bb926481c4019f9f28572040011591ef6799dd8888c/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/bbbaa51c4fc3774e917e4a6cbb861d2a3d67af7ebe6c873330a2531e1492fc60/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/62d43b115189dfd89dfbf258eadbee475412ac6c33689f3426de2d8e1d344cd7/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/08cf5de575627eb248255f65e09f9d341c1e4fcdf6c5789e9f77772df92df610/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/087edfd200381e59190e21b546015a2b9cb840c4e71ded12dbaf423215c69c70/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/5dc786e6e2cc08dd16d3f20e3e3a2f24e367012fecc32d48d5cf1f095cdcd91a/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/e87b7bfb40db67abfec46a8a8b4f88a416f66753b60633c60193380278b3204b/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/c342f0b63e0f29921b58b0962a533f0921073eebb601fc5a665767d433f425d3/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/bc800b4e35a7d49a65ee598fb4b34685cc5992aeffc9c5c7ea8aedbec41c0a17/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/ff555f4e9382ac2cebba82f931f196831e0a93bd199fb50f4392760db5653827/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/1bba642fa88eeb9fd7ab55aa2d7f047ac3c0318b079677ff82cd4a1329b89818/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/f2ab2fd2833099a738fb8278fda1687e8ccdfee625cba9e116cf582b4a3d1811/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/57b926fad8915b9b1ddcd51ceb4ea3e1f21c1dc32d268334d9232df25fc2656f/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/fe372636b6ccfa36fddefca77b1b46ec9c07b73e66b5dd9d5bb137db21690aa6/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/0980f717251fcc0c05f251aeefe30db03faf1d50db72a9508725fb35e8026dd7/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/6d4d9a7b46f2171c3f85099d76cbdc0e309d394a71522b38797b4cd8b76a3e00/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/d19e0d8d4d63c0dcbae5aa5e5909bfeb38f2e5fda4ad3315d4d710817e534e35/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/58f85c5db343d567fd2115e2d2ab47359c385a20a217435b7e0eb5ec39143615/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/c11bf0325f6569496abb474267c195c39bb1a4eae826a3a4063844dd251d9882/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/71a991d3c88c7831371ad7d91a9676648f683977204dad3aba83c17d1ef769c8/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/0a00451303da93797d08ecc35a4c0f007a7eadbfaf5a2facdd174efd02feffb2/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/c6163f5fdaccabef13bd140eadc3c37d9ecaf1f9b760356dab63afa498c3d75f/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/3cf04eaeb800db0a9c7fb869e448225a3ea1b4a4ab7d4981945f1f460b87a52e/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/a5f158481052d59e1446ce48920068de74a09b9fcd7db154f269e223a6f9f3a8/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.768101    4869 manager.go:217] Machine: {Timestamp:2026-10-30 02:55:30.767664972 +0000 UTC m=+0.089244682 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099764 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b2ea8b1011694ed5088bcd8f6f99 SystemUUID:ec24b2ea-8b10-1169-4ed5-088bcd8f6f99 BootID:e5e39d82-5223-43ac-917f-7debe6760832 Filesystems:[{Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/28695845-d672-425c-9848-4d6894a5427f/volumes/kubernetes.io~projected/kube-api-access-cnws7 DeviceMajor:0 DeviceMinor:229 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c3d8f64a7ef88215ebaed68d25084ee8db14cdc243d86a1e595fb8055d329e30/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2/volumes/kubernetes.io~projected/kube-api-access-cht4n DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/21c64927-d977-4fa0-88fe-27c90b7dc9fc/volumes/kubernetes.io~projected/kube-api-access-rwn9z DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d60e8e37ed4f7be8c399950b142dc8823432cc7b007ec65c40175b045629a6d6/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~projected/kube-api-access-hg6kr DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d593dab9e58c5771378e8bfd016c7a9b5bf3993ab39e3b98cd079b36304eb88d/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dab5c412-1558-4d16-88c2-0b3f3dd21790/volumes/kubernetes.io~projected/kube-api-access-4dsdg DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~projected/kube-api-access-2tjnz DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7742b225675dbdb6b9f2cd10a0ac40c06341e2ed2e6526c887d9a1e3ccb18ee1/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~projected/kube-api-access-d44lk DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~projected/kube-api-access-57cr4 DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~projected/kube-api-access-nsqfr DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/686e472eb8c4126b1d9fd49039a214ffcaadbb961d74d9278aac22c9ee814f02/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f5bb4192-b645-4e9e-8f49-1d1e546092aa/volumes/kubernetes.io~projected/kube-api-access-cvbwh DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c5453609066de83a8d7f308125b091b01cbf2ae3ecc97147dd151ebba7ac6c6a/userdata/shm DeviceMajor:0 DeviceMinor:221 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4767108b-7fd3-45da-9ea7-7f076f96034b/volumes/kubernetes.io~projected/kube-api-access-946v9 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e243aa8e-a8a4-4e4c-9a45-d9929f315b73/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee94a9ce92ec780c4f7ad56f6728f7149b6353d5e28f09a0bcedc5bd316055bc/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~projected/kube-api-access-mwrpp DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c/volumes/kubernetes.io~projected/kube-api-access-f8kmr DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/36f4613d183ecbebc8ac79a95a4d45f8dd23c5f24a509f5b2bef007bdf028f25/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3c4d4295-8f60-43ba-bedd-3f62177e646a/volumes/kubernetes.io~projected/kube-api-access-tbb5q DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/18b6b191-b504-4b31-add7-fdc98bea9aec/volumes/kubernetes.io~projected/kube-api-access-h2lmb DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7df42d8d3dd70183321924898d9d6ad73f27af3e9ff257de157d391ab0d81793/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8814d09f-6e78-4cb5-9536-16527a4b1d30/volumes/kubernetes.io~projected/kube-api-access-pjxwf DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4c594df1-aa1e-497a-b6c2-56f3620ced99/volumes/kubernetes.io~projected/kube-api-access-ssb2n DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6f88cfca-1150-49ac-812b-2b77442e467b/volumes/kubernetes.io~projected/kube-api-access-mg4zs DeviceMajor:0 DeviceMinor:293 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b2e9d2d650cd85d06344b0ef0cedaca62990a26ee8fe0450bed5a8df248d3df0/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/512891c4-1cba-468a-aafb-0c016eb455c2/volumes/kubernetes.io~projected/kube-api-access-pm9xk DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96c52d37-b38b-48d0-a335-ca4b56fa97d4/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~projected/kube-api-access-crpb8 DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/200ab7b80b8bbb9a36e41aa034416f200ce0e7221c97c7004e0d2556ac6128e0/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a895e88-4ff6-436e-9e50-dcff54933988/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c2b7d72c150db7013fdc99832ea16e6bf008d6c06565d2f34863841e75d01dd/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/78ec5656-f9f4-4a45-a60f-f31fd5e569b9/volumes/kubernetes.io~projected/kube-api-access-9qzzc DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5869efa1-9154-450e-a09b-710f9a51dcfc/volumes/kubernetes.io~projected/kube-api-access-kvqw5 DeviceMajor:0 DeviceMinor:232 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7cd6aa53-869a-4820-beb5-dd8a2d819fda/volumes/kubernetes.io~projected/kube-api-access-p4hx7 DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8cb3501b-daca-440a-8791-b3e41b7128e1/volumes/kubernetes.io~projected/kube-api-access-4k6pw DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c97e94c13464a75bae6f2b163c23c3b97eefaa72f97b69d4dd44d5b98df8e8cb/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7fee346376a0532386ebebd81c42d5de16020b6ca044f140244afff94e0e91bc/userdata/shm DeviceMajor:0 DeviceMinor:73 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bce09833-e763-408f-bd70-4c15801d184b/volumes/kubernetes.io~projected/kube-api-access-xf6b7 DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/451d2693e529c1685f745c894dcdd603a129136cae2175ab0be3fc46e5b9afef/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/da4a70f6bf3e5ef023af359abba9486ecfcb02302d3ea935666fa3278b1231da/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1a1fec2d-c429-4c09-bff4-330ff2e95935/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/53c1ac838ca2a526b1d94b26cee291d76d2c2637e295c8d4402bf5006aba0454/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/defeb4c3-553f-4427-836a-72b5f1bbc0d4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cf3cfb725fdb6ff95c33a794ccc5d663867ad51fa87aa5a78c3df71a0fb91a58/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/27d32073f0571702962c2aaa5a64a4d7570a105e8fc0ee899a22376f8e611388/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/93516eb5-fe40-4cd8-9b26-7d1b8b240879/volumes/kubernetes.io~projected/kube-api-access-th92m DeviceMajor:0 DeviceMinor:306 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ad3e816f-1810-4e16-9392-f393580c75b3/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b7777b7541d38b5b94aa12be7700b6b7779a12fd975b50e96d2b1a078272064/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/421331b3-cfe2-4595-932a-1e40125ab04a/volumes/kubernetes.io~projected/kube-api-access-gcmsr DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:200ab7b80b8bbb9 MacAddress:1e:a8:60:dd:55:fc Speed:10000 Mtu:8901} {Name:27d32073f057170 MacAddress:0a:54:73:49:38:9b Speed:10000 Mtu:8901} {Name:36f4613d183ecbe MacAddress:e6:c2:48:98:5e:94 Speed:10000 Mtu:8901} {Name:4c2b7d72c150db7 MacAddress:8e:10:6b:47:d7:0c Speed:10000 Mtu:8901} {Name:53c1ac838ca2a52 MacAddress:9e:56:fc:4f:c1:03 Speed:10000 Mtu:8901} {Name:7df42d8d3dd7018 MacAddress:8e:c5:e9:fb:90:31 Speed:10000 Mtu:8901} {Name:b2e9d2d650cd85d MacAddress:f2:90:f0:34:7e:ab Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f5:26:3e:39 Speed:0 Mtu:9001} {Name:br-int MacAddress:ce:1f:12:d9:fa:e5 Speed:0 Mtu:8901} {Name:c5453609066de83 MacAddress:e6:d8:b1:4e:b3:11 Speed:10000 Mtu:8901} {Name:c97e94c13464a75 MacAddress:02:ed:e2:80:7d:76 Speed:10000 Mtu:8901} {Name:d593dab9e58c577 MacAddress:86:cf:2c:92:ce:ff Speed:10000 Mtu:8901} {Name:d60e8e37ed4f7be MacAddress:2e:2b:2a:60:cc:fd Speed:10000 Mtu:8901} {Name:ee94a9ce92ec780 MacAddress:ea:66:3e:9a:7a:68 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f5:26:3e:39 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:66:78:7c:7a:0f:44 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ce:d5:11:94:27:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.768467    4869 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.768506    4869 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.768887    4869 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.768914    4869 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769032    4869 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769040    4869 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769050    4869 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769062    4869 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769080    4869 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769267    4869 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769377    4869 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769416    4869 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769426    4869 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769435    4869 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769442    4869 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.769451    4869 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.770455    4869 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.770466    4869 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.770987    4869 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773278    4869 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773287    4869 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773398    4869 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773598    4869 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773629    4869 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773725    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773742    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773750    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773759    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773765    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773772    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773779    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773786    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773794    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773800    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773808    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773817    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773842    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.773848    4869 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.777027    4869 server.go:1263] "Started kubelet"
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.777077    4869 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.777520    4869 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:55:30.780395 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.777664    4869 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.778066    4869 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.778286    4869 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.781495    4869 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.782105    4869 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.782124    4869 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.782128    4869 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found"
Oct 30 02:55:30.782680 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.782395    4869 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:55:30.785400 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785322    4869 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:55:30.785593 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785557    4869 factory.go:153] Registering CRI-O factory
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785599    4869 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785609    4869 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:49:52 +0000 UTC" deadline="2028-03-31 00:40:15.040298819 +0000 UTC"
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785633    4869 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h44m44.254669077s"
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785649    4869 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785658    4869 factory.go:55] Registering systemd factory
Oct 30 02:55:30.785675 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785665    4869 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:55:30.785959 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785682    4869 factory.go:103] Registering Raw factory
Oct 30 02:55:30.785959 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.785697    4869 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:55:30.786053 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.786046    4869 manager.go:319] Starting recovery of all containers
Oct 30 02:55:30.787362 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787325    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bce09833-e763-408f-bd70-4c15801d184b" volumeName="kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787364    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce98fed2-c56e-4d43-aba4-5e7173e0dbe2" volumeName="kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787378    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c4d4295-8f60-43ba-bedd-3f62177e646a" volumeName="kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787390    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c594df1-aa1e-497a-b6c2-56f3620ced99" volumeName="kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787403    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="512891c4-1cba-468a-aafb-0c016eb455c2" volumeName="kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787415    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8814d09f-6e78-4cb5-9536-16527a4b1d30" volumeName="kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir" seLinuxMountContext=""
Oct 30 02:55:30.787435 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787426    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cb3501b-daca-440a-8791-b3e41b7128e1" volumeName="kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787439    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dab5c412-1558-4d16-88c2-0b3f3dd21790" volumeName="kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787455    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a1fec2d-c429-4c09-bff4-330ff2e95935" volumeName="kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787466    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a895e88-4ff6-436e-9e50-dcff54933988" volumeName="kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787477    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="421331b3-cfe2-4595-932a-1e40125ab04a" volumeName="kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787494    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="512891c4-1cba-468a-aafb-0c016eb455c2" volumeName="kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787516    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ec5656-f9f4-4a45-a60f-f31fd5e569b9" volumeName="kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787528    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787541    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787552    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="defeb4c3-553f-4427-836a-72b5f1bbc0d4" volumeName="kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787564    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b6b191-b504-4b31-add7-fdc98bea9aec" volumeName="kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787595    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4767108b-7fd3-45da-9ea7-7f076f96034b" volumeName="kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787607    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96c52d37-b38b-48d0-a335-ca4b56fa97d4" volumeName="kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787617    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787629    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7cd6aa53-869a-4820-beb5-dd8a2d819fda" volumeName="kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787639    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8814d09f-6e78-4cb5-9536-16527a4b1d30" volumeName="kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787648    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96c52d37-b38b-48d0-a335-ca4b56fa97d4" volumeName="kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787656    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="421331b3-cfe2-4595-932a-1e40125ab04a" volumeName="kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787663    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787670    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cb3501b-daca-440a-8791-b3e41b7128e1" volumeName="kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787677    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787684    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets" seLinuxMountContext=""
Oct 30 02:55:30.787700 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787693    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787714    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787722    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5bb4192-b645-4e9e-8f49-1d1e546092aa" volumeName="kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787729    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28695845-d672-425c-9848-4d6894a5427f" volumeName="kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787744    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a1f4153-3d9d-418e-8834-2495c11521c1" volumeName="kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787751    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ec5656-f9f4-4a45-a60f-f31fd5e569b9" volumeName="kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787758    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787765    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787772    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="defeb4c3-553f-4427-836a-72b5f1bbc0d4" volumeName="kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787779    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a" volumeName="kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787786    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21c64927-d977-4fa0-88fe-27c90b7dc9fc" volumeName="kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787794    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28695845-d672-425c-9848-4d6894a5427f" volumeName="kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787801    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="512891c4-1cba-468a-aafb-0c016eb455c2" volumeName="kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787808    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787816    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7cd6aa53-869a-4820-beb5-dd8a2d819fda" volumeName="kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787822    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad3e816f-1810-4e16-9392-f393580c75b3" volumeName="kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787829    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad3e816f-1810-4e16-9392-f393580c75b3" volumeName="kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787835    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787843    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b6b191-b504-4b31-add7-fdc98bea9aec" volumeName="kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787858    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a895e88-4ff6-436e-9e50-dcff54933988" volumeName="kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787866    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="421331b3-cfe2-4595-932a-1e40125ab04a" volumeName="kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787874    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f88cfca-1150-49ac-812b-2b77442e467b" volumeName="kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787881    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93516eb5-fe40-4cd8-9b26-7d1b8b240879" volumeName="kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787888    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787895    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a895e88-4ff6-436e-9e50-dcff54933988" volumeName="kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787903    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bce09833-e763-408f-bd70-4c15801d184b" volumeName="kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787912    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="297ad00c-8e12-4e27-94d0-4d10d1e4ed0c" volumeName="kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787920    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ec5656-f9f4-4a45-a60f-f31fd5e569b9" volumeName="kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787932    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7cd6aa53-869a-4820-beb5-dd8a2d819fda" volumeName="kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787939    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787946    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8e034b-416f-4187-b568-30706c130228" volumeName="kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787955    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="defeb4c3-553f-4427-836a-72b5f1bbc0d4" volumeName="kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787962    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a1fec2d-c429-4c09-bff4-330ff2e95935" volumeName="kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787973    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a1fec2d-c429-4c09-bff4-330ff2e95935" volumeName="kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787987    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28695845-d672-425c-9848-4d6894a5427f" volumeName="kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.787994    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788000    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93516eb5-fe40-4cd8-9b26-7d1b8b240879" volumeName="kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788007    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788014    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c594df1-aa1e-497a-b6c2-56f3620ced99" volumeName="kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788021    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788029    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a1fec2d-c429-4c09-bff4-330ff2e95935" volumeName="kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788036    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="512891c4-1cba-468a-aafb-0c016eb455c2" volumeName="kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788043    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" volumeName="kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788051    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a1fec2d-c429-4c09-bff4-330ff2e95935" volumeName="kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788057    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="297ad00c-8e12-4e27-94d0-4d10d1e4ed0c" volumeName="kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788064    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5869efa1-9154-450e-a09b-710f9a51dcfc" volumeName="kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788071    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7cd6aa53-869a-4820-beb5-dd8a2d819fda" volumeName="kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788079    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8091bf52-5313-499d-b574-665bf650cabe" volumeName="kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788087    4869 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96c52d37-b38b-48d0-a335-ca4b56fa97d4" volumeName="kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp" seLinuxMountContext=""
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788094    4869 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:55:30.788286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.788099    4869 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:55:30.808602 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.808554    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:30.809189 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.809168    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:30.810597 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.810518    4869 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:55:30.812455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.812368    4869 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:55:30.812455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.812390    4869 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:55:30.812455 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.812410    4869 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:55:30.812676 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.812454    4869 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 02:55:30.826517 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826490    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="7f8a7e18bd1c08368198db01f531ff3b5d0a17b113d80445d9f0e1dd28bddbdf" exitCode=0
Oct 30 02:55:30.826517 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826517    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="1ef56a66ef5b28855173c0003655b7446c52efb597f2b8c1b6381a18a8b4c69c" exitCode=0
Oct 30 02:55:30.826683 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826526    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="ed2e3907ad88399779880e3497a03080bbe023471f78aeb81bdd67b436a22d5a" exitCode=0
Oct 30 02:55:30.826683 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826534    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="791d7fbe1ed73bd374fecb9c51aaea384e1e0e8ea626c8ce861433df4109991b" exitCode=0
Oct 30 02:55:30.826683 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826539    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="8cbb15123504696e7cafd8bda70d225920e600e738f402241e4936b42b2cce3b" exitCode=0
Oct 30 02:55:30.826683 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.826546    4869 generic.go:356] "Generic (PLEG): container finished" podID="512891c4-1cba-468a-aafb-0c016eb455c2" containerID="bb8f57a6129857aef4bb5cff35e6b92a860afa27915f545ba38c5ddb373dd3df" exitCode=0
Oct 30 02:55:30.829379 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.829359    4869 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 02:55:30.831770 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.831749    4869 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:30.831958 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.831943    4869 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:30.844051 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.844029    4869 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:30.844467 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.844450    4869 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:30.853028 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.853004    4869 generic.go:356] "Generic (PLEG): container finished" podID="4c7d0a5578df212c9c3593b8eec7e8e4" containerID="8b9acff20e60fa1c29686849ee766f61b22667272870bbab7210ec65d377030a" exitCode=0
Oct 30 02:55:30.859467 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.859450    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:30.859557 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.859478    4869 generic.go:356] "Generic (PLEG): container finished" podID="7cd6aa53-869a-4820-beb5-dd8a2d819fda" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd" exitCode=255
Oct 30 02:55:30.880943 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.880928    4869 manager.go:324] Recovery completed
Oct 30 02:55:30.898110 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898084    4869 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:55:30.898110 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898108    4869 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:55:30.898293 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898130    4869 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:55:30.898342 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898312    4869 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 02:55:30.898386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898328    4869 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 02:55:30.898386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898351    4869 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 02:55:30.898386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898360    4869 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 02:55:30.898386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898368    4869 policy_none.go:50] "Start"
Oct 30 02:55:30.898386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898386    4869 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:55:30.898614 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898399    4869 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:55:30.898669 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898636    4869 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 02:55:30.898669 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898648    4869 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 02:55:30.898669 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.898656    4869 policy_none.go:44] "Start"
Oct 30 02:55:30.903324 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.903291    4869 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:55:30.905920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.905907    4869 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:55:30.906408 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.905933    4869 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:55:30.906481 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906410    4869 server.go:87] "Starting device plugin registration server"
Oct 30 02:55:30.906665 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906654    4869 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:55:30.906699 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906666    4869 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:55:30.906796 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906777    4869 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:55:30.906969 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906940    4869 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:55:30.906969 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906977    4869 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:55:30.906969 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.906985    4869 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:55:30.907127 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.907038    4869 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:55:30.906966671Z","UUID":"a667d673-e3dc-41f0-9ac7-9066ba5d3d9b","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:55:30.908157 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.908129    4869 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:55:30.908322 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.908301    4869 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:55:30.908322 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.908325    4869 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:55:30.912605 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.912545    4869 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"]
Oct 30 02:55:30.913197 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913162    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"13f55a681f1d4144d42dc77996364937","Type":"ContainerStarted","Data":"f9c4322dbd7b3d1e68c96549c271216d113acd8e375b7ecfd598e4fd937a54a9"}
Oct 30 02:55:30.913197 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913195    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"13f55a681f1d4144d42dc77996364937","Type":"ContainerStarted","Data":"3110b589f9f27013c848aea6323071ba8304d9b355d128bb4251248f31c49ac1"}
Oct 30 02:55:30.913319 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913222    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerStarted","Data":"85cf70d1423199c1f399b772b088c9aeabff8552aede898d5c9c1af1995accee"}
Oct 30 02:55:30.913319 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913240    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerDied","Data":"8b9acff20e60fa1c29686849ee766f61b22667272870bbab7210ec65d377030a"}
Oct 30 02:55:30.913319 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913253    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"4c7d0a5578df212c9c3593b8eec7e8e4","Type":"ContainerStarted","Data":"522cbc908f43e33ad0a7f321dcd32fa9d96bd9de5aa457977c8a0d33ddc14424"}
Oct 30 02:55:30.913319 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913266    4869 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:30.913512 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.913433    4869 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:30.936717 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.936691    4869 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:30.936844 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.936751    4869 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:30.937252 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:30.937232    4869 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:30.937338 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:30.937286    4869 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.007842 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.007818    4869 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:31.009617 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.009600    4869 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:31.009685 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.009628    4869 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:31.009685 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.009640    4869 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:31.009685 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.009673    4869 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.029886 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.029861    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.029956 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.029889    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.029956 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.029905    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.042539 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.042521    4869 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.042626 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.042566    4869 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130078 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130023    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130078 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130050    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130078 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130067    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130213 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130114    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f55a681f1d4144d42dc77996364937-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"13f55a681f1d4144d42dc77996364937\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130213 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130120    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.130213 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.130138    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7d0a5578df212c9c3593b8eec7e8e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"4c7d0a5578df212c9c3593b8eec7e8e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.770496 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.770469    4869 apiserver.go:52] "Watching apiserver"
Oct 30 02:55:31.833638 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.833615    4869 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:55:31.834284 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.834257    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-s56gp","openshift-console-operator/console-operator-7cd56b8dbc-54724","openshift-multus/multus-lrd2x","openshift-cluster-node-tuning-operator/tuned-cz5h7","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd","openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal","kube-system/kas-connection-checker-685895c7c9-2g88s","openshift-image-registry/image-registry-5878468f4d-kskh5","kube-system/konnectivity-agent-k2fmn","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72","openshift-multus/multus-additional-cni-plugins-td8hm","openshift-network-diagnostics/network-check-target-qmgzm","openshift-ingress/router-default-74b8b5c987-q7zgf","kube-system/global-pull-secret-syncer-l6fz8","openshift-dns/node-resolver-6n4q9","kube-system/kas-connection-checker-685895c7c9-gkprk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal","openshift-network-operator/iptables-alerter-xgfjk","openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc","openshift-image-registry/image-registry-bd78d557-mlzrw","openshift-insights/insights-operator-7c4986d449-nf7zn","openshift-ingress-canary/ingress-canary-ndt7q","openshift-ovn-kubernetes/ovnkube-node-9z9fv","openshift-dns/dns-default-q2p4k","openshift-network-console/networking-console-plugin-86c478bb88-xzlxr","kube-system/kas-connection-checker-685895c7c9-hxlmq","openshift-multus/network-metrics-daemon-8gbpm","openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd","openshift-insights/insights-runtime-extractor-qts9q"]
Oct 30 02:55:31.835490 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.835472    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.837434 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.837414    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.838247 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.838231    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.838671 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.838650    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.839096 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.839073    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:31.841135 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.841115    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:31.850780 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850755    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.850861 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850781    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.850861 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850808    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.850861 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850813    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.850861 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850841    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 02:55:31.851031 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.850962    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.851377 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851361    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 02:55:31.851463 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851364    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 02:55:31.851463 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851411    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 02:55:31.851463 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851421    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v88tk\""
Oct 30 02:55:31.851463 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851456    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f2mz6\""
Oct 30 02:55:31.851688 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851491    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 02:55:31.851688 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.851593    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.852152 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.852135    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.853135 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.853116    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.862699 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862679    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 02:55:31.862699 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862690    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 02:55:31.862841 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862771    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.862841 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862779    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fwhc6\""
Oct 30 02:55:31.862841 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862781    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 02:55:31.862841 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862840    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.862991 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862819    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rpnvj\""
Oct 30 02:55:31.862991 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862854    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-88wxv\""
Oct 30 02:55:31.862991 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862859    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 02:55:31.862991 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.862859    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 02:55:31.863114 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863045    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.863146 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863118    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.863564 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863537    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:55:31.863564 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863564    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.863718 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863704    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 02:55:31.863930 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863916    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 02:55:31.863976 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863944    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.864055 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.863978    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866228 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866210    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866218    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866234    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866264    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866277    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866302    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866301    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866330    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866336    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866373    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866407    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866406    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866414    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866518    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866543    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.866613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866519    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866644    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866651    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866660    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866751    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866856    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866915    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866936    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.867012 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.866978    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867188    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867200    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867208    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867190    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867289    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867241    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867240    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867232    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867344    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 02:55:31.867371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867371    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 02:55:31.867724 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867381    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rl6cl\""
Oct 30 02:55:31.867724 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867382    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.867724 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.867430    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fdxtg\""
Oct 30 02:55:31.873173 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.873156    4869 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.874564 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874546    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:55:31.874656 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874557    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:55:31.874656 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874612    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:55:31.874656 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874629    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.874795 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874657    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tpj88\""
Oct 30 02:55:31.874795 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874706    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:55:31.874795 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.874789    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.875429 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.875307    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ph67z\""
Oct 30 02:55:31.875935 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.875913    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 02:55:31.876053 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.876033    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 02:55:31.877547 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.877529    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:55:31.877691 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.877672    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 02:55:31.877857 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.877831    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzrlw\""
Oct 30 02:55:31.877857 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.877850    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:55:31.878119 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.877982    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d8b4w\""
Oct 30 02:55:31.878188 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878152    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-chr82\""
Oct 30 02:55:31.878188 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878172    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:55:31.878286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878234    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xzg75\""
Oct 30 02:55:31.878331 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878105    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ft4zm\""
Oct 30 02:55:31.878573 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878551    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:55:31.878653 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878559    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 02:55:31.878731 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878716    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-kdtjd\""
Oct 30 02:55:31.878797 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878737    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vvtsk\""
Oct 30 02:55:31.878797 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878759    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-jgdgr\""
Oct 30 02:55:31.879003 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.878981    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6gpqv\""
Oct 30 02:55:31.879062 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879008    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rwtzz\""
Oct 30 02:55:31.879128 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879102    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:55:31.879194 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879153    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9qpgh\""
Oct 30 02:55:31.879194 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879180    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:55:31.879194 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879186    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kn7z4\""
Oct 30 02:55:31.879394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879259    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:55:31.879394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879364    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8ljf8\""
Oct 30 02:55:31.879487 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879443    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bckpk\""
Oct 30 02:55:31.879682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879665    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:55:31.879766 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879674    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57t79\""
Oct 30 02:55:31.879766 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879648    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9wgn\""
Oct 30 02:55:31.879907 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879891    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mk2hv\""
Oct 30 02:55:31.879984 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.879955    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 02:55:31.880072 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.880041    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 02:55:31.884054 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.884037    4869 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:55:31.896627 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.896609    4869 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:31.896691 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:31.896647    4869 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"
Oct 30 02:55:31.933625 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933601    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.933706 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933636    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.933706 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933654    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.933777 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933717    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.933777 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933744    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.933777 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933765    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933783    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933798    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933821    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933839    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933869    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmsr\" (UniqueName: \"kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933883    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.933922 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933913    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933944    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.933973    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934017    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934039    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/defeb4c3-553f-4427-836a-72b5f1bbc0d4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934080    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lmb\" (UniqueName: \"kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934083    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/defeb4c3-553f-4427-836a-72b5f1bbc0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934098    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.934159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934133    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934165    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934217    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934230    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-tuned\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934268    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8kmr\" (UniqueName: \"kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934316    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934351    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934379    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934403    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934426    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28695845-d672-425c-9848-4d6894a5427f-config-volume\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934436    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934451    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934461    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.934500 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934499    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnws7\" (UniqueName: \"kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934512    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cni-binary-copy\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934541    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934638    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934674    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934683    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-tmp\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934699    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946v9\" (UniqueName: \"kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934746    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934775    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934809    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934838    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovn-node-metrics-cert\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934929    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934949    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934954    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934964    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934979    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.934997 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.934993    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935013    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935060    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935082    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935104    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935119    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935155    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935185    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935205    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935226    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935252    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935291    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935321    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-env-overrides\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935359    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a1f4153-3d9d-418e-8834-2495c11521c1-nginx-conf\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935369    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935405    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935411    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935411    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935433    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935459    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qzzc\" (UniqueName: \"kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935457    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935482    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935509    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.935538 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935531    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935571    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93516eb5-fe40-4cd8-9b26-7d1b8b240879-data-volume\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935591    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbb5q\" (UniqueName: \"kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935688    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935714    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935745    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad3e816f-1810-4e16-9392-f393580c75b3-agent-certs\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935750    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935748    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935789    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935853    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cr4\" (UniqueName: \"kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935924    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-config\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.935952    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936031    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18b6b191-b504-4b31-add7-fdc98bea9aec-serviceca\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936034    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936081    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814d09f-6e78-4cb5-9536-16527a4b1d30-tmp-dir\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936088    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936139    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936174    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936201    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936239    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/512891c4-1cba-468a-aafb-0c016eb455c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936276    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936326    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936343    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936345    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-daemon-config\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936366    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936384    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.936394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936399    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936416    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936452    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-snapshots\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936466    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cht4n\" (UniqueName: \"kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n\") pod \"kas-connection-checker-685895c7c9-hxlmq\" (UID: \"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2\") " pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936494    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936607    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/421331b3-cfe2-4595-932a-1e40125ab04a-config\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936606    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936710    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936739    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936755    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936784    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936831    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936863    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936897    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936912    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-default-certificate\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936925    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6kr\" (UniqueName: \"kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936932    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-service-ca-bundle\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936960    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.936978    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-config\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937021    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937046    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937067    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937090    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937116    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937147    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937177    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937234    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwn9z\" (UniqueName: \"kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z\") pod \"network-check-source-6f78d59f99-q25gd\" (UID: \"21c64927-d977-4fa0-88fe-27c90b7dc9fc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937258    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crpb8\" (UniqueName: \"kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937275    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937326    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937358    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937376    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937412    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937450    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbwh\" (UniqueName: \"kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh\") pod \"kas-connection-checker-685895c7c9-gkprk\" (UID: \"f5bb4192-b645-4e9e-8f49-1d1e546092aa\") " pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937479    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.937483 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937496    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937512    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6b7\" (UniqueName: \"kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937601    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937630    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937691    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937719    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937741    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937762    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937790    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937800    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bce09833-e763-408f-bd70-4c15801d184b-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937813    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937836    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937854    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-iptables-alerter-script\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937877    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937942    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937952    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-stats-auth\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937980    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.937995    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-original-pull-secret\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938006    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938024    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/421331b3-cfe2-4595-932a-1e40125ab04a-serving-cert\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938032    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqw5\" (UniqueName: \"kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5\") pod \"volume-data-source-validator-58c9f5f46d-2wmxc\" (UID: \"5869efa1-9154-450e-a09b-710f9a51dcfc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938052    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938077    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938095    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938111    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938125    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938141    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938158    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdg\" (UniqueName: \"kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg\") pod \"kas-connection-checker-685895c7c9-2g88s\" (UID: \"dab5c412-1558-4d16-88c2-0b3f3dd21790\") " pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938163    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28695845-d672-425c-9848-4d6894a5427f-tmp-dir\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938174    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th92m\" (UniqueName: \"kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938190    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938215    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938267    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad3e816f-1810-4e16-9392-f393580c75b3-konnectivity-ca\") pod \"konnectivity-agent-k2fmn\" (UID: \"ad3e816f-1810-4e16-9392-f393580c75b3\") " pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938285    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938299    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96c52d37-b38b-48d0-a335-ca4b56fa97d4-tmp\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938332    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938364    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6pw\" (UniqueName: \"kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938535    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjxwf\" (UniqueName: \"kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938546    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a1fec2d-c429-4c09-bff4-330ff2e95935-ovnkube-script-lib\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938613    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938683    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938765    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938782    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cd6aa53-869a-4820-beb5-dd8a2d819fda-serving-cert\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938814    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqfr\" (UniqueName: \"kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.938913 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938850    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.938968    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44lk\" (UniqueName: \"kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939002    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939031    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939053    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-serving-cert\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939058    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939100    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939134    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssb2n\" (UniqueName: \"kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939162    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939188    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hx7\" (UniqueName: \"kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939233    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9xk\" (UniqueName: \"kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939287    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cb3501b-daca-440a-8791-b3e41b7128e1-cert\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:31.940314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.939491    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7cd6aa53-869a-4820-beb5-dd8a2d819fda-trusted-ca\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.955661 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.955642    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmsr\" (UniqueName: \"kubernetes.io/projected/421331b3-cfe2-4595-932a-1e40125ab04a-kube-api-access-gcmsr\") pod \"service-ca-operator-544d749c8c-j4vqj\" (UID: \"421331b3-cfe2-4595-932a-1e40125ab04a\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj"
Oct 30 02:55:31.956061 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.956046    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8kmr\" (UniqueName: \"kubernetes.io/projected/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-kube-api-access-f8kmr\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:31.957497 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.957478    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnws7\" (UniqueName: \"kubernetes.io/projected/28695845-d672-425c-9848-4d6894a5427f-kube-api-access-cnws7\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:31.957842 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.957826    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946v9\" (UniqueName: \"kubernetes.io/projected/4767108b-7fd3-45da-9ea7-7f076f96034b-kube-api-access-946v9\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:31.966492 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.966473    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbb5q\" (UniqueName: \"kubernetes.io/projected/3c4d4295-8f60-43ba-bedd-3f62177e646a-kube-api-access-tbb5q\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:31.966638 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.966623    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6kr\" (UniqueName: \"kubernetes.io/projected/96c52d37-b38b-48d0-a335-ca4b56fa97d4-kube-api-access-hg6kr\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:31.967958 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.967936    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lmb\" (UniqueName: \"kubernetes.io/projected/18b6b191-b504-4b31-add7-fdc98bea9aec-kube-api-access-h2lmb\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:31.968075 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968037    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.968075 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968054    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hx7\" (UniqueName: \"kubernetes.io/projected/7cd6aa53-869a-4820-beb5-dd8a2d819fda-kube-api-access-p4hx7\") pod \"console-operator-7cd56b8dbc-54724\" (UID: \"7cd6aa53-869a-4820-beb5-dd8a2d819fda\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:31.968075 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968042    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.968240 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968115    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4zs\" (UniqueName: \"kubernetes.io/projected/6f88cfca-1150-49ac-812b-2b77442e467b-kube-api-access-mg4zs\") pod \"network-check-target-qmgzm\" (UID: \"6f88cfca-1150-49ac-812b-2b77442e467b\") " pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:31.968240 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968224    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:31.968427 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.968408    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cr4\" (UniqueName: \"kubernetes.io/projected/e243aa8e-a8a4-4e4c-9a45-d9929f315b73-kube-api-access-57cr4\") pod \"insights-operator-7c4986d449-nf7zn\" (UID: \"e243aa8e-a8a4-4e4c-9a45-d9929f315b73\") " pod="openshift-insights/insights-operator-7c4986d449-nf7zn"
Oct 30 02:55:31.972148 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972127    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qzzc\" (UniqueName: \"kubernetes.io/projected/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-kube-api-access-9qzzc\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:31.972252 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972168    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjxwf\" (UniqueName: \"kubernetes.io/projected/8814d09f-6e78-4cb5-9536-16527a4b1d30-kube-api-access-pjxwf\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:31.972598 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972558    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:31.972598 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972568    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6b7\" (UniqueName: \"kubernetes.io/projected/bce09833-e763-408f-bd70-4c15801d184b-kube-api-access-xf6b7\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:31.972756 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972609    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwn9z\" (UniqueName: \"kubernetes.io/projected/21c64927-d977-4fa0-88fe-27c90b7dc9fc-kube-api-access-rwn9z\") pod \"network-check-source-6f78d59f99-q25gd\" (UID: \"21c64927-d977-4fa0-88fe-27c90b7dc9fc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-q25gd"
Oct 30 02:55:31.972756 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972675    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cht4n\" (UniqueName: \"kubernetes.io/projected/ce98fed2-c56e-4d43-aba4-5e7173e0dbe2-kube-api-access-cht4n\") pod \"kas-connection-checker-685895c7c9-hxlmq\" (UID: \"ce98fed2-c56e-4d43-aba4-5e7173e0dbe2\") " pod="kube-system/kas-connection-checker-685895c7c9-hxlmq"
Oct 30 02:55:31.972874 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972851    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssb2n\" (UniqueName: \"kubernetes.io/projected/4c594df1-aa1e-497a-b6c2-56f3620ced99-kube-api-access-ssb2n\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:31.972960 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.972927    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crpb8\" (UniqueName: \"kubernetes.io/projected/defeb4c3-553f-4427-836a-72b5f1bbc0d4-kube-api-access-crpb8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-64w72\" (UID: \"defeb4c3-553f-4427-836a-72b5f1bbc0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72"
Oct 30 02:55:31.973045 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.973023    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44lk\" (UniqueName: \"kubernetes.io/projected/2a895e88-4ff6-436e-9e50-dcff54933988-kube-api-access-d44lk\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:31.973151 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.973137    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqfr\" (UniqueName: \"kubernetes.io/projected/1a1fec2d-c429-4c09-bff4-330ff2e95935-kube-api-access-nsqfr\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:31.973238 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.973147    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th92m\" (UniqueName: \"kubernetes.io/projected/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-api-access-th92m\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:31.973286 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.973271    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqw5\" (UniqueName: \"kubernetes.io/projected/5869efa1-9154-450e-a09b-710f9a51dcfc-kube-api-access-kvqw5\") pod \"volume-data-source-validator-58c9f5f46d-2wmxc\" (UID: \"5869efa1-9154-450e-a09b-710f9a51dcfc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-2wmxc"
Oct 30 02:55:31.973962 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.973947    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9xk\" (UniqueName: \"kubernetes.io/projected/512891c4-1cba-468a-aafb-0c016eb455c2-kube-api-access-pm9xk\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:31.974687 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.974666    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6pw\" (UniqueName: \"kubernetes.io/projected/8cb3501b-daca-440a-8791-b3e41b7128e1-kube-api-access-4k6pw\") pod \"ingress-canary-ndt7q\" (UID: \"8cb3501b-daca-440a-8791-b3e41b7128e1\") " pod="openshift-ingress-canary/ingress-canary-ndt7q"
Oct 30 02:55:31.975839 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.975823    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbwh\" (UniqueName: \"kubernetes.io/projected/f5bb4192-b645-4e9e-8f49-1d1e546092aa-kube-api-access-cvbwh\") pod \"kas-connection-checker-685895c7c9-gkprk\" (UID: \"f5bb4192-b645-4e9e-8f49-1d1e546092aa\") " pod="kube-system/kas-connection-checker-685895c7c9-gkprk"
Oct 30 02:55:31.978666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:31.978649    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsdg\" (UniqueName: \"kubernetes.io/projected/dab5c412-1558-4d16-88c2-0b3f3dd21790-kube-api-access-4dsdg\") pod \"kas-connection-checker-685895c7c9-2g88s\" (UID: \"dab5c412-1558-4d16-88c2-0b3f3dd21790\") " pod="kube-system/kas-connection-checker-685895c7c9-2g88s"
Oct 30 02:55:32.040462 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040411    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.040548 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040475    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:32.040548 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040500    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040548 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040524    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040548 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040546    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040572    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040545    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18b6b191-b504-4b31-add7-fdc98bea9aec-host\") pod \"node-ca-s56gp\" (UID: \"18b6b191-b504-4b31-add7-fdc98bea9aec\") " pod="openshift-image-registry/node-ca-s56gp"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040614    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-system-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040639    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-conf\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040657    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-netns\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040695    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040722    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040737    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-hostroot\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.040761 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040749    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040776    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040780    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040793    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-device-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040738    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-socket-dir-parent\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040801    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040827    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040835    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-k8s-cni-cncf-io\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040841    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-kubelet-config\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040852    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040870    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-cnibin\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040879    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040893    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-socket-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040899    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.040913    4869 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040935    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.040945    4869 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040976    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.040983    4869 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.040996    4869 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041004    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041017    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.540998584 +0000 UTC m=+1.862578295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.040932    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8814d09f-6e78-4cb5-9536-16527a4b1d30-hosts-file\") pod \"node-resolver-6n4q9\" (UID: \"8814d09f-6e78-4cb5-9536-16527a4b1d30\") " pod="openshift-dns/node-resolver-6n4q9"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041023    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-slash\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041044    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-conf-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041048    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-etc-selinux\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041039    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541029404 +0000 UTC m=+1.862609105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041079    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041100    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041120    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-var-lib-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041130    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041145    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-sys-fs\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.041142 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041152    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041186    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a-dbus\") pod \"global-pull-secret-syncer-l6fz8\" (UID: \"fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a\") " pod="kube-system/global-pull-secret-syncer-l6fz8"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041183    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041202    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93516eb5-fe40-4cd8-9b26-7d1b8b240879-crio-socket\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041215    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041220    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-bin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041233    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041248    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041284    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-var-lib-kubelet\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041289    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-ovn\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041333    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041353    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041370    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041373    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-sys\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041386    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041390    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-registration-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041395    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-lib-modules\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041402    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041417    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041422    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-node-log\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041434    4869 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041477    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041486    4869 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041494    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert podName:3a1f4153-3d9d-418e-8834-2495c11521c1 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541482762 +0000 UTC m=+1.863062474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-xzlxr" (UID: "3a1f4153-3d9d-418e-8834-2495c11521c1") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041434    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041520    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541510711 +0000 UTC m=+1.863090408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041540    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041556    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041570    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041598    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/512891c4-1cba-468a-aafb-0c016eb455c2-system-cni-dir\") pod \"multus-additional-cni-plugins-td8hm\" (UID: \"512891c4-1cba-468a-aafb-0c016eb455c2\") " pod="openshift-multus/multus-additional-cni-plugins-td8hm"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041608    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-netd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041610    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041630    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-host\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041632    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041660    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041672    4869 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041692    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041701    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041708    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541696747 +0000 UTC m=+1.863276447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041740    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041746    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysconfig\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041763    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041782    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041798    4869 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041805    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041827    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041845    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041868    4869 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041879    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541863983 +0000 UTC m=+1.863443702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041845    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-multus-cni-dir\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041908    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041867    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-run\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041916    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-modprobe-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041798    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-etc-kubernetes\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041807    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-sysctl-d\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.041909    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-log-socket\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.041925    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls podName:4c594df1-aa1e-497a-b6c2-56f3620ced99 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.541914868 +0000 UTC m=+1.863494579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-kkntd" (UID: "4c594df1-aa1e-497a-b6c2-56f3620ced99") : secret "samples-operator-tls" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042004    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042033    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042059    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042085    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042094    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/297ad00c-8e12-4e27-94d0-4d10d1e4ed0c-host-slash\") pod \"iptables-alerter-xgfjk\" (UID: \"297ad00c-8e12-4e27-94d0-4d10d1e4ed0c\") " pod="openshift-network-operator/iptables-alerter-xgfjk"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042097    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-systemd\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042112    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042138    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-cni-bin\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042143    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-systemd-units\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042139    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042172    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-cni-multus\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042186    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042214    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042237    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.042250    4869 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042269    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-run-netns\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.042263    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.542239972 +0000 UTC m=+1.863819686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.042312    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.542301699 +0000 UTC m=+1.863881396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : secret "metrics-daemon-secret" not found
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042331    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042371    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042375    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93516eb5-fe40-4cd8-9b26-7d1b8b240879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042393    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042416    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042307    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-kubelet\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042439    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042455    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042477    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042485    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-etc-openvswitch\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042473    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-run-multus-certs\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.042682 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042501    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042505    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4767108b-7fd3-45da-9ea7-7f076f96034b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-875mf\" (UID: \"4767108b-7fd3-45da-9ea7-7f076f96034b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-875mf"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042513    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-host-var-lib-kubelet\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042525    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042533    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-run-systemd\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042537    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1fec2d-c429-4c09-bff4-330ff2e95935-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9z9fv\" (UID: \"1a1fec2d-c429-4c09-bff4-330ff2e95935\") " pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042572    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78ec5656-f9f4-4a45-a60f-f31fd5e569b9-cnibin\") pod \"multus-lrd2x\" (UID: \"78ec5656-f9f4-4a45-a60f-f31fd5e569b9\") " pod="openshift-multus/multus-lrd2x"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.042593    4869 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.042626    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96c52d37-b38b-48d0-a335-ca4b56fa97d4-etc-kubernetes\") pod \"tuned-cz5h7\" (UID: \"96c52d37-b38b-48d0-a335-ca4b56fa97d4\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5h7"
Oct 30 02:55:32.045097 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.042667    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.542652343 +0000 UTC m=+1.864232045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:32.117467 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.117440    4869 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.138625 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.138603    4869 scope.go:122] "RemoveContainer" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"
Oct 30 02:55:32.371112 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.371037    4869 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.546369 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546343    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:32.546481 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546373    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:32.546481 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546392    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:32.546481 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546471    4869 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546502    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546482036 +0000 UTC m=+2.868061733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546529    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546561    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546565    4869 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546593    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546564171 +0000 UTC m=+2.868143867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : secret "metrics-daemon-secret" not found
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546647    4869 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546660    4869 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5878468f4d-kskh5: secret "image-registry-tls" not found
Oct 30 02:55:32.546670 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546665    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546645748 +0000 UTC m=+2.868225461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546647    4869 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546691    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls podName:8091bf52-5313-499d-b574-665bf650cabe nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546683194 +0000 UTC m=+2.868262891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls") pod "image-registry-5878468f4d-kskh5" (UID: "8091bf52-5313-499d-b574-665bf650cabe") : secret "image-registry-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546692    4869 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd78d557-mlzrw: secret "image-registry-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546732    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls podName:bd8e034b-416f-4187-b568-30706c130228 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546721557 +0000 UTC m=+2.868301272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls") pod "image-registry-bd78d557-mlzrw" (UID: "bd8e034b-416f-4187-b568-30706c130228") : secret "image-registry-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546730    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546755    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546782    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546815    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.546848    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546858    4869 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546881    4869 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:32.546920 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546908    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546892138 +0000 UTC m=+2.868471859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.547322 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546941    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.546923255 +0000 UTC m=+2.868502966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:32.547322 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.546970    4869 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.547322 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.547017    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.547002271 +0000 UTC m=+2.868581985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.547322 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.547023    4869 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:55:32.549067 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.549050    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a1f4153-3d9d-418e-8834-2495c11521c1-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-xzlxr\" (UID: \"3a1f4153-3d9d-418e-8834-2495c11521c1\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:32.549208 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.549192    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c594df1-aa1e-497a-b6c2-56f3620ced99-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-kkntd\" (UID: \"4c594df1-aa1e-497a-b6c2-56f3620ced99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:32.551040 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.551018    4869 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.738701 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.738678    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"
Oct 30 02:55:32.739764 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.739748    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"
Oct 30 02:55:32.757453 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.757428    4869 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.831238 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.831210    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:32.878210 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.878188    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 02:55:32.878595 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.878567    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/1.log"
Oct 30 02:55:32.878663 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.878618    4869 generic.go:356] "Generic (PLEG): container finished" podID="7cd6aa53-869a-4820-beb5-dd8a2d819fda" containerID="49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8" exitCode=255
Oct 30 02:55:32.878720 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.878692    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" event={"ID":"7cd6aa53-869a-4820-beb5-dd8a2d819fda","Type":"ContainerDied","Data":"49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8"}
Oct 30 02:55:32.878782 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.878767    4869 scope.go:122] "RemoveContainer" containerID="2b36056e3ad8c1aecc688cfd56e6be4dc301c999227787500aac13765f1fe4bd"
Oct 30 02:55:32.879613 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.879594    4869 scope.go:122] "RemoveContainer" containerID="49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8"
Oct 30 02:55:32.879818 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:32.879800    4869 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:32.942665 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:32.942639    4869 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:33.047194 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.047138    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:33.053069 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.053049    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd"]
Oct 30 02:55:33.097996 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.097972    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-xzlxr"]
Oct 30 02:55:33.103954 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:33.103930    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1f4153_3d9d_418e_8834_2495c11521c1.slice/crio-79e7bf9070513e0663f559b75dcd4cb786f99baff43107d9a97da3a872823058 WatchSource:0}: Error finding container 79e7bf9070513e0663f559b75dcd4cb786f99baff43107d9a97da3a872823058: Status 404 returned error can't find the container with id 79e7bf9070513e0663f559b75dcd4cb786f99baff43107d9a97da3a872823058
Oct 30 02:55:33.105923 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.105908    4869 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 02:55:33.557019 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.556990    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:33.557153 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557024    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:33.557153 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557053    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:33.557153 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557079    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:33.557153 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557116    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557158    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557172    4869 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557186    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557230    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557235    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.55721476 +0000 UTC m=+4.878794477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557267    4869 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557295    4869 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:33.557326 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557170    4869 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:33.557749 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557332    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.557313988 +0000 UTC m=+4.878893704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:33.557749 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557353    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs podName:2a895e88-4ff6-436e-9e50-dcff54933988 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.557343049 +0000 UTC m=+4.878922752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs") pod "router-default-74b8b5c987-q7zgf" (UID: "2a895e88-4ff6-436e-9e50-dcff54933988") : secret "router-metrics-certs-default" not found
Oct 30 02:55:33.557749 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557371    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.557362619 +0000 UTC m=+4.878942320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:33.557749 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557373    4869 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:33.557749 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.557434    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.557414369 +0000 UTC m=+4.878994077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : secret "metrics-daemon-secret" not found
Oct 30 02:55:33.558023 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.557755    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a895e88-4ff6-436e-9e50-dcff54933988-service-ca-bundle\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:33.559453 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.559429    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"image-registry-bd78d557-mlzrw\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") " pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:33.559541 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.559483    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"image-registry-5878468f4d-kskh5\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") " pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:33.640024 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.639999    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:33.652179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.651843    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:33.884844 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.884781    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 02:55:33.885284 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.885182    4869 scope.go:122] "RemoveContainer" containerID="49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8"
Oct 30 02:55:33.885432 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:33.885409    4869 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:33.886628 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.886597    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr" event={"ID":"3a1f4153-3d9d-418e-8834-2495c11521c1","Type":"ContainerStarted","Data":"79e7bf9070513e0663f559b75dcd4cb786f99baff43107d9a97da3a872823058"}
Oct 30 02:55:33.887850 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.887825    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd" event={"ID":"4c594df1-aa1e-497a-b6c2-56f3620ced99","Type":"ContainerStarted","Data":"1b699d5de70cd4028eb15e24671775cd1497d84843af34673c3dfb11070b68ad"}
Oct 30 02:55:33.984969 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:33.984934    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:55:33.989149 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:33.989123    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8e034b_416f_4187_b568_30706c130228.slice/crio-706da7ddef81fd25c12355f06946868724c1a2dfdb504481505144e99ea6f507 WatchSource:0}: Error finding container 706da7ddef81fd25c12355f06946868724c1a2dfdb504481505144e99ea6f507: Status 404 returned error can't find the container with id 706da7ddef81fd25c12355f06946868724c1a2dfdb504481505144e99ea6f507
Oct 30 02:55:34.014403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.014372    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:55:34.019680 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:34.019644    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8091bf52_5313_499d_b574_665bf650cabe.slice/crio-49bc16014fa17d6feb937969d64928f462c4557a0e1cbf786d377e30c24cc1ad WatchSource:0}: Error finding container 49bc16014fa17d6feb937969d64928f462c4557a0e1cbf786d377e30c24cc1ad: Status 404 returned error can't find the container with id 49bc16014fa17d6feb937969d64928f462c4557a0e1cbf786d377e30c24cc1ad
Oct 30 02:55:34.892944 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.892919    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" event={"ID":"bd8e034b-416f-4187-b568-30706c130228","Type":"ContainerStarted","Data":"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"}
Oct 30 02:55:34.893260 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.892974    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" event={"ID":"bd8e034b-416f-4187-b568-30706c130228","Type":"ContainerStarted","Data":"706da7ddef81fd25c12355f06946868724c1a2dfdb504481505144e99ea6f507"}
Oct 30 02:55:34.894670 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.894643    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6n4q9_8814d09f-6e78-4cb5-9536-16527a4b1d30/dns-node-resolver/0.log"
Oct 30 02:55:34.894765 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.894669    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-xzlxr" event={"ID":"3a1f4153-3d9d-418e-8834-2495c11521c1","Type":"ContainerStarted","Data":"84e95835f6887d4d327d3ad096fd21b76778a727ffb0e880b25c65a7d6be6a8e"}
Oct 30 02:55:34.897938 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.897913    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" event={"ID":"8091bf52-5313-499d-b574-665bf650cabe","Type":"ContainerStarted","Data":"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"}
Oct 30 02:55:34.897978 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:34.897962    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" event={"ID":"8091bf52-5313-499d-b574-665bf650cabe","Type":"ContainerStarted","Data":"49bc16014fa17d6feb937969d64928f462c4557a0e1cbf786d377e30c24cc1ad"}
Oct 30 02:55:35.469875 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.469844    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:55:35.493258 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.493236    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5878468f4d-kskh5_8091bf52-5313-499d-b574-665bf650cabe/registry/0.log"
Oct 30 02:55:35.575423 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.575397    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:35.575547 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.575443    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:35.575547 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.575465    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:35.575547 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.575534    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575552    4869 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.575566    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575566    4869 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575637    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.575618118 +0000 UTC m=+8.897197834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575639    4869 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575661    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs podName:3c4d4295-8f60-43ba-bedd-3f62177e646a nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.575646549 +0000 UTC m=+8.897226266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs") pod "network-metrics-daemon-8gbpm" (UID: "3c4d4295-8f60-43ba-bedd-3f62177e646a") : secret "metrics-daemon-secret" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575680    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.57566855 +0000 UTC m=+8.897248276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:35.575724 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575691    4869 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:35.575982 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:35.575748    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.575732375 +0000 UTC m=+8.897312091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:35.577804 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.577787    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a895e88-4ff6-436e-9e50-dcff54933988-metrics-certs\") pod \"router-default-74b8b5c987-q7zgf\" (UID: \"2a895e88-4ff6-436e-9e50-dcff54933988\") " pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:35.694008 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.693984    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bd78d557-mlzrw_bd8e034b-416f-4187-b568-30706c130228/registry/0.log"
Oct 30 02:55:35.736531 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.736486    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:35.903016 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.902976    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd" event={"ID":"4c594df1-aa1e-497a-b6c2-56f3620ced99","Type":"ContainerStarted","Data":"9c3ee77e6ec89dfc731053307d9d9d3799861d0c7006649a2695ad516c321f6d"}
Oct 30 02:55:35.903352 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.903048    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-kkntd" event={"ID":"4c594df1-aa1e-497a-b6c2-56f3620ced99","Type":"ContainerStarted","Data":"cd4557d2804132087bd8c99bd16d3bd60f1064857818cb1b40642e275814f673"}
Oct 30 02:55:35.903352 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.903177    4869 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:35.903352 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:35.903342    4869 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:36.046213 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.046156    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b8b5c987-q7zgf"]
Oct 30 02:55:36.048809 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:36.048781    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a895e88_4ff6_436e_9e50_dcff54933988.slice/crio-c42ebaf502c914a1985a3d75ca8c7691b00378fc98c44bf1dc682d69c4f18a83 WatchSource:0}: Error finding container c42ebaf502c914a1985a3d75ca8c7691b00378fc98c44bf1dc682d69c4f18a83: Status 404 returned error can't find the container with id c42ebaf502c914a1985a3d75ca8c7691b00378fc98c44bf1dc682d69c4f18a83
Oct 30 02:55:36.293264 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.293237    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s56gp_18b6b191-b504-4b31-add7-fdc98bea9aec/node-ca/0.log"
Oct 30 02:55:36.718496 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.718470    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:55:36.892734 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.892709    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ndt7q_8cb3501b-daca-440a-8791-b3e41b7128e1/serve-healthcheck-canary/0.log"
Oct 30 02:55:36.907594 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.907553    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b8b5c987-q7zgf" event={"ID":"2a895e88-4ff6-436e-9e50-dcff54933988","Type":"ContainerStarted","Data":"92281b90f1f2a4b7ae0c41101ffcafa0032ecd867a63f332f34395069189f42a"}
Oct 30 02:55:36.907918 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:36.907615    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b8b5c987-q7zgf" event={"ID":"2a895e88-4ff6-436e-9e50-dcff54933988","Type":"ContainerStarted","Data":"c42ebaf502c914a1985a3d75ca8c7691b00378fc98c44bf1dc682d69c4f18a83"}
Oct 30 02:55:37.693918 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:37.693889    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-64w72_defeb4c3-553f-4427-836a-72b5f1bbc0d4/kube-storage-version-migrator-operator/0.log"
Oct 30 02:55:37.727721 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:37.727687    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:37.727952 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:37.727935    4869 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:37.737520 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:37.737496    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:37.739860 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:37.739840    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:38.914124 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:38.914094    4869 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:39.604920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.604886    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:39.604920 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.604925    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.604947    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.604974    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605039    4869 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605047    4869 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605047    4869 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605105    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls podName:28695845-d672-425c-9848-4d6894a5427f nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.60508641 +0000 UTC m=+16.926666120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls") pod "dns-default-q2p4k" (UID: "28695845-d672-425c-9848-4d6894a5427f") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605125    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls podName:bce09833-e763-408f-bd70-4c15801d184b nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.605116596 +0000 UTC m=+16.926696292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxbgt" (UID: "bce09833-e763-408f-bd70-4c15801d184b") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:39.605169 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.605140    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls podName:93516eb5-fe40-4cd8-9b26-7d1b8b240879 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.605131595 +0000 UTC m=+16.926711296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qts9q" (UID: "93516eb5-fe40-4cd8-9b26-7d1b8b240879") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:39.607324 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.607299    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d4295-8f60-43ba-bedd-3f62177e646a-metrics-certs\") pod \"network-metrics-daemon-8gbpm\" (UID: \"3c4d4295-8f60-43ba-bedd-3f62177e646a\") " pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:39.641593 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.641552    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gbpm"
Oct 30 02:55:39.668432 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.668413    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9z9fv"
Oct 30 02:55:39.710980 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.710956    4869 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:39.711321 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.711303    4869 scope.go:122] "RemoveContainer" containerID="49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8"
Oct 30 02:55:39.711500 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:39.711481    4869 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-54724_openshift-console-operator(7cd6aa53-869a-4820-beb5-dd8a2d819fda)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda"
Oct 30 02:55:39.940592 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:39.940549    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gbpm"]
Oct 30 02:55:39.943929 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:39.943895    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4d4295_8f60_43ba_bedd_3f62177e646a.slice/crio-b821e1bfaea1b3c009d46fc61db8ca3a867763ff75f8fe54248231f4da3ecf67 WatchSource:0}: Error finding container b821e1bfaea1b3c009d46fc61db8ca3a867763ff75f8fe54248231f4da3ecf67: Status 404 returned error can't find the container with id b821e1bfaea1b3c009d46fc61db8ca3a867763ff75f8fe54248231f4da3ecf67
Oct 30 02:55:40.353691 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:40.353626    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:55:40.921946 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:40.921914    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gbpm" event={"ID":"3c4d4295-8f60-43ba-bedd-3f62177e646a","Type":"ContainerStarted","Data":"48f337173eaad47665a3537619b7f822340321a37d1758957e697545f2f7a3dd"}
Oct 30 02:55:40.922048 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:40.921971    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gbpm" event={"ID":"3c4d4295-8f60-43ba-bedd-3f62177e646a","Type":"ContainerStarted","Data":"fe662d709edeb8facaba285479abc403c343539d068d8ab56faee40453dab3a6"}
Oct 30 02:55:40.922048 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:40.921989    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gbpm" event={"ID":"3c4d4295-8f60-43ba-bedd-3f62177e646a","Type":"ContainerStarted","Data":"b821e1bfaea1b3c009d46fc61db8ca3a867763ff75f8fe54248231f4da3ecf67"}
Oct 30 02:55:42.813234 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.813203    4869 scope.go:122] "RemoveContainer" containerID="49d9c3fead6257470b163727ce130f32f660b8ed6ee2dd9673a68a9a3167d8c8"
Oct 30 02:55:42.930453 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.930429    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 02:55:42.930588 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.930493    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" event={"ID":"7cd6aa53-869a-4820-beb5-dd8a2d819fda","Type":"ContainerStarted","Data":"2b0bcf773915349d6d660e729afd28eeb2c0bf7219e1b7bc0b492c3ed141c209"}
Oct 30 02:55:42.930810 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.930791    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:42.931822 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.931798    4869 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-54724 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.19:8443/readyz\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
Oct 30 02:55:42.931926 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:42.931834    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724" podUID="7cd6aa53-869a-4820-beb5-dd8a2d819fda" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.19:8443/readyz\": dial tcp 10.132.0.19:8443: connect: connection refused"
Oct 30 02:55:43.476317 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:43.476281    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:43.476478 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:43.476463    4869 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:43.477631 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:43.477570    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74b8b5c987-q7zgf"
Oct 30 02:55:43.938171 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:43.938147    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-54724"
Oct 30 02:55:45.663669 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:45.663628    4869 patch_prober.go:29] interesting pod/image-registry-bd78d557-mlzrw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:55:45.664250 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:45.663679    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:55:47.667563 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.667526    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:47.668068 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.667570    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:47.668068 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.667620    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:47.670139 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.670111    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28695845-d672-425c-9848-4d6894a5427f-metrics-tls\") pod \"dns-default-q2p4k\" (UID: \"28695845-d672-425c-9848-4d6894a5427f\") " pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:47.670255 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.670140    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93516eb5-fe40-4cd8-9b26-7d1b8b240879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qts9q\" (UID: \"93516eb5-fe40-4cd8-9b26-7d1b8b240879\") " pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:47.670255 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.670232    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bce09833-e763-408f-bd70-4c15801d184b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxbgt\" (UID: \"bce09833-e763-408f-bd70-4c15801d184b\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:47.738743 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.738717    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"
Oct 30 02:55:47.753196 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.753173    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:47.754296 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:47.754274    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qts9q"
Oct 30 02:55:48.037131 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.037069    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt"]
Oct 30 02:55:48.039228 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:48.039204    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce09833_e763_408f_bd70_4c15801d184b.slice/crio-e5ab2bee08f8ef046ee9d9ab732f3acb0a04ddd13ad425e72e82f62a6d71395a WatchSource:0}: Error finding container e5ab2bee08f8ef046ee9d9ab732f3acb0a04ddd13ad425e72e82f62a6d71395a: Status 404 returned error can't find the container with id e5ab2bee08f8ef046ee9d9ab732f3acb0a04ddd13ad425e72e82f62a6d71395a
Oct 30 02:55:48.074571 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.074549    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2p4k"]
Oct 30 02:55:48.076719 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:48.076693    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28695845_d672_425c_9848_4d6894a5427f.slice/crio-e10bd3d55fd0853bc3db73b41919647cfb62486f9c6d0d2e41f187979b54cf16 WatchSource:0}: Error finding container e10bd3d55fd0853bc3db73b41919647cfb62486f9c6d0d2e41f187979b54cf16: Status 404 returned error can't find the container with id e10bd3d55fd0853bc3db73b41919647cfb62486f9c6d0d2e41f187979b54cf16
Oct 30 02:55:48.078000 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.077975    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qts9q"]
Oct 30 02:55:48.084876 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:48.084853    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93516eb5_fe40_4cd8_9b26_7d1b8b240879.slice/crio-ec83f47a77ec862df3574b31126f0fa186e03f7c47e5f352c816570c56292d08 WatchSource:0}: Error finding container ec83f47a77ec862df3574b31126f0fa186e03f7c47e5f352c816570c56292d08: Status 404 returned error can't find the container with id ec83f47a77ec862df3574b31126f0fa186e03f7c47e5f352c816570c56292d08
Oct 30 02:55:48.954778 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.954699    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qts9q" event={"ID":"93516eb5-fe40-4cd8-9b26-7d1b8b240879","Type":"ContainerStarted","Data":"785308efeeda0ae75e31b9f9d677af4b911319a8bcdfbadfb30e4932b5803a4e"}
Oct 30 02:55:48.954778 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.954770    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qts9q" event={"ID":"93516eb5-fe40-4cd8-9b26-7d1b8b240879","Type":"ContainerStarted","Data":"152b4f523e36f1d99977478b07f5b2867830277606030d8d512c63fb5b3e617e"}
Oct 30 02:55:48.955269 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.954800    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qts9q" event={"ID":"93516eb5-fe40-4cd8-9b26-7d1b8b240879","Type":"ContainerStarted","Data":"ec83f47a77ec862df3574b31126f0fa186e03f7c47e5f352c816570c56292d08"}
Oct 30 02:55:48.956371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.956345    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt" event={"ID":"bce09833-e763-408f-bd70-4c15801d184b","Type":"ContainerStarted","Data":"e5ab2bee08f8ef046ee9d9ab732f3acb0a04ddd13ad425e72e82f62a6d71395a"}
Oct 30 02:55:48.957724 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:48.957698    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2p4k" event={"ID":"28695845-d672-425c-9848-4d6894a5427f","Type":"ContainerStarted","Data":"e10bd3d55fd0853bc3db73b41919647cfb62486f9c6d0d2e41f187979b54cf16"}
Oct 30 02:55:49.772386 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:49.771398    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:55:49.778261 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:49.778215    4869 patch_prober.go:29] interesting pod/image-registry-bd78d557-mlzrw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:55:49.778405 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:49.778272    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:55:49.967610 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:49.966942    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxbgt" event={"ID":"bce09833-e763-408f-bd70-4c15801d184b","Type":"ContainerStarted","Data":"1bcd4a619483cf2f221e9592666d467ee3ae793fd761a5405dccc37b4885a5ed"}
Oct 30 02:55:50.971531 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:50.971475    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2p4k" event={"ID":"28695845-d672-425c-9848-4d6894a5427f","Type":"ContainerStarted","Data":"ddd555f3a5b87611af6c1f81d20ef1d74c3ba4435755ac5d35ad21e0645fcd24"}
Oct 30 02:55:50.972003 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:50.971548    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2p4k" event={"ID":"28695845-d672-425c-9848-4d6894a5427f","Type":"ContainerStarted","Data":"a3bff50eaf2cfa5616c0aa14da876d9a3b9039354752284773fa210d39cf78b3"}
Oct 30 02:55:50.972003 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:50.971599    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:55:50.973924 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:50.973895    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qts9q" event={"ID":"93516eb5-fe40-4cd8-9b26-7d1b8b240879","Type":"ContainerStarted","Data":"5e6e41ca797ecfafd73f8cbf8a05327c578d45467f3b3a30da0c52b9b738f728"}
Oct 30 02:55:52.082615 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:52.082558    4869 patch_prober.go:29] interesting pod/image-registry-5878468f4d-kskh5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:55:52.083007 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:52.082643    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:55:56.911963 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:56.911925    4869 patch_prober.go:29] interesting pod/image-registry-5878468f4d-kskh5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:55:56.912371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:56.911980    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:55:57.818848 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:55:57.818810    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:55:58.682935 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.682900    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rfc5t"]
Oct 30 02:55:58.718642 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.718617    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.756795 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.756772    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 02:55:58.756947 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.756926    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-szgzh\""
Oct 30 02:55:58.757069 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.757039    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 02:55:58.757107 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.757053    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 02:55:58.768752 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.768732    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 02:55:58.850585 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850560    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850688 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850621    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-wtmp\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850737 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850685    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-root\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850737 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850717    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-metrics-client-ca\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850808 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850737    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850808 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850797    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-tls\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850882 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850856    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-sys\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850925 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850880    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d99rk\" (UniqueName: \"kubernetes.io/projected/bc031a43-a635-42ac-a6a8-92a7d5a05c34-kube-api-access-d99rk\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.850925 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.850903    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-textfile\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952014 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.951951    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-wtmp\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952014 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.951989    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-root\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952014 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952011    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-metrics-client-ca\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952031    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952053    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-tls\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952069    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-root\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952141    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-wtmp\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952144    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-sys\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952190 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952174    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc031a43-a635-42ac-a6a8-92a7d5a05c34-sys\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952429 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952214    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d99rk\" (UniqueName: \"kubernetes.io/projected/bc031a43-a635-42ac-a6a8-92a7d5a05c34-kube-api-access-d99rk\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952429 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952245    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-textfile\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952429 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952297    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952588 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952556    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-textfile\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952737 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952712    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.952797 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.952741    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc031a43-a635-42ac-a6a8-92a7d5a05c34-metrics-client-ca\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.954314 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.954294    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-tls\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.954485 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.954469    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc031a43-a635-42ac-a6a8-92a7d5a05c34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:58.974782 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:58.974764    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d99rk\" (UniqueName: \"kubernetes.io/projected/bc031a43-a635-42ac-a6a8-92a7d5a05c34-kube-api-access-d99rk\") pod \"node-exporter-rfc5t\" (UID: \"bc031a43-a635-42ac-a6a8-92a7d5a05c34\") " pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:59.067861 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:59.067840    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfc5t"
Oct 30 02:55:59.109657 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:55:59.109633    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc031a43_a635_42ac_a6a8_92a7d5a05c34.slice/crio-da4ce870147763c39987efdf07b94fa720ebb6af52d70106791f2298eb956880 WatchSource:0}: Error finding container da4ce870147763c39987efdf07b94fa720ebb6af52d70106791f2298eb956880: Status 404 returned error can't find the container with id da4ce870147763c39987efdf07b94fa720ebb6af52d70106791f2298eb956880
Oct 30 02:55:59.777147 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:59.777111    4869 patch_prober.go:29] interesting pod/image-registry-bd78d557-mlzrw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:55:59.777564 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:55:59.777168    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:56:00.011494 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:00.011465    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfc5t" event={"ID":"bc031a43-a635-42ac-a6a8-92a7d5a05c34","Type":"ContainerStarted","Data":"da4ce870147763c39987efdf07b94fa720ebb6af52d70106791f2298eb956880"}
Oct 30 02:56:00.980456 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:00.980432    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q2p4k"
Oct 30 02:56:01.016257 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:01.016202    4869 generic.go:356] "Generic (PLEG): container finished" podID="bc031a43-a635-42ac-a6a8-92a7d5a05c34" containerID="ecf5597ce9514a26b3bd12c4e5a0d09975bc67098134cfd10320f2fc95d096de" exitCode=0
Oct 30 02:56:01.016352 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:01.016256    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfc5t" event={"ID":"bc031a43-a635-42ac-a6a8-92a7d5a05c34","Type":"ContainerDied","Data":"ecf5597ce9514a26b3bd12c4e5a0d09975bc67098134cfd10320f2fc95d096de"}
Oct 30 02:56:01.709391 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:01.709354    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2fmn"
Oct 30 02:56:02.022791 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:02.022704    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfc5t" event={"ID":"bc031a43-a635-42ac-a6a8-92a7d5a05c34","Type":"ContainerStarted","Data":"b23bbb8b548c99c3ef5195cf84a2d67bcd54e9498627838ced21315a2e00b8fa"}
Oct 30 02:56:02.022791 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:02.022759    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfc5t" event={"ID":"bc031a43-a635-42ac-a6a8-92a7d5a05c34","Type":"ContainerStarted","Data":"1edc4d07d506c76ea6b50f500d18ae3826480223539b6e44e1e56743119a4703"}
Oct 30 02:56:02.072517 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:02.072455    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rfc5t" podStartSLOduration=2.330284507 podStartE2EDuration="4.072438133s" totalImagesPullingTime="1.650511932s" totalInitContainerRuntime="91.641694ms" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:56:02.071644252 +0000 UTC m=+31.393223970" watchObservedRunningTime="2026-10-30 02:56:02.072438133 +0000 UTC m=+31.394017851"
Oct 30 02:56:02.081780 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:02.081753    4869 patch_prober.go:29] interesting pod/image-registry-5878468f4d-kskh5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 02:56:02.081899 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:02.081795    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 02:56:05.472629 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:05.472596    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qmgzm"
Oct 30 02:56:06.912243 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:06.912213    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:56:09.776427 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:09.776399    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:56:13.327164 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:13.327091    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:56:14.805750 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:14.805707    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry" containerID="cri-o://a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79" gracePeriod=30
Oct 30 02:56:15.038083 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.038060    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:56:15.056115 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056071    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056184 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056120    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056184 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056152    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056268 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056184    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056268 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056243    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056283    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056359    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056497 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056472    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") pod \"bd8e034b-416f-4187-b568-30706c130228\" (UID: \"bd8e034b-416f-4187-b568-30706c130228\") "
Oct 30 02:56:15.056658 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056625    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:15.057419 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.056862    4869 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-trusted-ca\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.057848 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.057790    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:15.058921 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.058896    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:15.059003 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.058910    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:15.059267 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.059246    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:15.059465 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.059432    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:15.059836 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.059805    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "kube-api-access-mwrpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:15.063383 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.063362    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted" pod "bd8e034b-416f-4187-b568-30706c130228" (UID: "bd8e034b-416f-4187-b568-30706c130228"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:56:15.073728 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.073705    4869 generic.go:356] "Generic (PLEG): container finished" podID="bd8e034b-416f-4187-b568-30706c130228" containerID="a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79" exitCode=0
Oct 30 02:56:15.073819 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.073753    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd78d557-mlzrw"
Oct 30 02:56:15.073819 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.073790    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" event={"ID":"bd8e034b-416f-4187-b568-30706c130228","Type":"ContainerDied","Data":"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"}
Oct 30 02:56:15.073937 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.073847    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bd78d557-mlzrw" event={"ID":"bd8e034b-416f-4187-b568-30706c130228","Type":"ContainerDied","Data":"706da7ddef81fd25c12355f06946868724c1a2dfdb504481505144e99ea6f507"}
Oct 30 02:56:15.073937 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.073878    4869 scope.go:122] "RemoveContainer" containerID="a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"
Oct 30 02:56:15.083740 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.083292    4869 scope.go:122] "RemoveContainer" containerID="a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"
Oct 30 02:56:15.083740 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:56:15.083674    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79\": container with ID starting with a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79 not found: ID does not exist" containerID="a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"
Oct 30 02:56:15.083866 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.083730    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79"} err="failed to get container status \"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79\": rpc error: code = NotFound desc = could not find container \"a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79\": container with ID starting with a5301e7025e12bfc10a95df18faafe99120d5809fcd412ca76ff35a976dcdf79 not found: ID does not exist"
Oct 30 02:56:15.129403 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.129378    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:56:15.133267 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.133246    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bd78d557-mlzrw"]
Oct 30 02:56:15.158058 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158025    4869 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd8e034b-416f-4187-b568-30706c130228-registry-certificates\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158058 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158059    4869 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd8e034b-416f-4187-b568-30706c130228-ca-trust-extracted\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158070    4869 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-bound-sa-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158081    4869 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-image-registry-private-configuration\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158090    4869 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-registry-tls\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158098    4869 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd8e034b-416f-4187-b568-30706c130228-installation-pull-secrets\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:15.158179 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:15.158110    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwrpp\" (UniqueName: \"kubernetes.io/projected/bd8e034b-416f-4187-b568-30706c130228-kube-api-access-mwrpp\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:16.817346 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:16.817310    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd8e034b-416f-4187-b568-30706c130228" path="/var/lib/kubelet/pods/bd8e034b-416f-4187-b568-30706c130228/volumes"
Oct 30 02:56:27.820706 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:56:27.820670    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:56:38.352825 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.352748    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry" containerID="cri-o://bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad" gracePeriod=30
Oct 30 02:56:38.595872 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.595848    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:56:38.718491 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718459    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718520    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718549    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718594    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718625    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718666 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718654    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718914 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718691    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.718914 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.718799    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") pod \"8091bf52-5313-499d-b574-665bf650cabe\" (UID: \"8091bf52-5313-499d-b574-665bf650cabe\") "
Oct 30 02:56:38.719252 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.719186    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:38.719252 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.719212    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:38.721246 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.721216    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:38.721394 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.721359    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:38.721529 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.721506    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:38.721603 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.721563    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "kube-api-access-2tjnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:38.721764 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.721741    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:38.725369 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.725350    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted" pod "8091bf52-5313-499d-b574-665bf650cabe" (UID: "8091bf52-5313-499d-b574-665bf650cabe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:56:38.819589 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819553    4869 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-image-registry-private-configuration\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819609    4869 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8091bf52-5313-499d-b574-665bf650cabe-ca-trust-extracted\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819627    4869 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-bound-sa-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819642    4869 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-registry-tls\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819656    4869 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-registry-certificates\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819678    4869 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8091bf52-5313-499d-b574-665bf650cabe-installation-pull-secrets\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819692 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819692    4869 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8091bf52-5313-499d-b574-665bf650cabe-trusted-ca\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:38.819895 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:38.819707    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tjnz\" (UniqueName: \"kubernetes.io/projected/8091bf52-5313-499d-b574-665bf650cabe-kube-api-access-2tjnz\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:56:39.164933 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.164866    4869 generic.go:356] "Generic (PLEG): container finished" podID="8091bf52-5313-499d-b574-665bf650cabe" containerID="bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad" exitCode=0
Oct 30 02:56:39.164933 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.164916    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5878468f4d-kskh5"
Oct 30 02:56:39.165084 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.164949    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" event={"ID":"8091bf52-5313-499d-b574-665bf650cabe","Type":"ContainerDied","Data":"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"}
Oct 30 02:56:39.165084 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.164991    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5878468f4d-kskh5" event={"ID":"8091bf52-5313-499d-b574-665bf650cabe","Type":"ContainerDied","Data":"49bc16014fa17d6feb937969d64928f462c4557a0e1cbf786d377e30c24cc1ad"}
Oct 30 02:56:39.165084 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.165011    4869 scope.go:122] "RemoveContainer" containerID="bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"
Oct 30 02:56:39.172853 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.172833    4869 scope.go:122] "RemoveContainer" containerID="bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"
Oct 30 02:56:39.173102 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:56:39.173084    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad\": container with ID starting with bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad not found: ID does not exist" containerID="bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"
Oct 30 02:56:39.173154 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.173110    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad"} err="failed to get container status \"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad\": rpc error: code = NotFound desc = could not find container \"bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad\": container with ID starting with bcd9a72f86a188c85ccbdeb72d74fbe17aa72829427859d253505f64033e05ad not found: ID does not exist"
Oct 30 02:56:39.226481 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.226458    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:56:39.238683 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:39.238659    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5878468f4d-kskh5"]
Oct 30 02:56:40.818208 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:40.818171    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8091bf52-5313-499d-b574-665bf650cabe" path="/var/lib/kubelet/pods/8091bf52-5313-499d-b574-665bf650cabe/volumes"
Oct 30 02:56:52.214553 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:52.214515    4869 generic.go:356] "Generic (PLEG): container finished" podID="421331b3-cfe2-4595-932a-1e40125ab04a" containerID="025c7038ef3a3b5a75f9ed6252b2d0e35d6ae8750216852200bbdf0f6d8aea3c" exitCode=0
Oct 30 02:56:52.214933 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:52.214615    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj" event={"ID":"421331b3-cfe2-4595-932a-1e40125ab04a","Type":"ContainerDied","Data":"025c7038ef3a3b5a75f9ed6252b2d0e35d6ae8750216852200bbdf0f6d8aea3c"}
Oct 30 02:56:52.214983 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:52.214947    4869 scope.go:122] "RemoveContainer" containerID="025c7038ef3a3b5a75f9ed6252b2d0e35d6ae8750216852200bbdf0f6d8aea3c"
Oct 30 02:56:53.219914 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:53.219875    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-j4vqj" event={"ID":"421331b3-cfe2-4595-932a-1e40125ab04a","Type":"ContainerStarted","Data":"a0c3131bfe5d675aba24ee40bacf7e9b7a01bcb39d38e07b5d02620654754bd4"}
Oct 30 02:56:56.233159 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.233089    4869 generic.go:356] "Generic (PLEG): container finished" podID="e243aa8e-a8a4-4e4c-9a45-d9929f315b73" containerID="7da108e137ba2c9965b6525ae2fc6cebe5911b82fdd76033903928550c8203c2" exitCode=0
Oct 30 02:56:56.233511 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.233161    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-nf7zn" event={"ID":"e243aa8e-a8a4-4e4c-9a45-d9929f315b73","Type":"ContainerDied","Data":"7da108e137ba2c9965b6525ae2fc6cebe5911b82fdd76033903928550c8203c2"}
Oct 30 02:56:56.233511 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.233447    4869 scope.go:122] "RemoveContainer" containerID="7da108e137ba2c9965b6525ae2fc6cebe5911b82fdd76033903928550c8203c2"
Oct 30 02:56:56.885222 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885189    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-67djd-htsft"]
Oct 30 02:56:56.885467 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885455    4869 cpu_manager.go:414] "containerMap: removing container" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry"
Oct 30 02:56:56.885512 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885469    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry"
Oct 30 02:56:56.885512 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885492    4869 cpu_manager.go:414] "containerMap: removing container" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry"
Oct 30 02:56:56.885512 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885497    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry"
Oct 30 02:56:56.885632 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885546    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="8091bf52-5313-499d-b574-665bf650cabe" containerName="registry"
Oct 30 02:56:56.885632 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.885556    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd8e034b-416f-4187-b568-30706c130228" containerName="registry"
Oct 30 02:56:56.888426 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.888410    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:56.911371 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:56.911350    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-67djd-htsft"]
Oct 30 02:56:57.045429 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.045399    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.045526 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.045449    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.045569 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.045520    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.045624 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.045598    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqq54\" (UniqueName: \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146281 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146223    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146281 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146257    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146281 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146278    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqq54\" (UniqueName: \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146453 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146318    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146727 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146710    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.146875 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.146857    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.147127 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.147108    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.169958 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.169927    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqq54\" (UniqueName: \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\") pod \"periodic-gathering-67djd-htsft\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") " pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.199863 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.199839    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:56:57.238789 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.238759    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-nf7zn" event={"ID":"e243aa8e-a8a4-4e4c-9a45-d9929f315b73","Type":"ContainerStarted","Data":"9396cd5b0f57827d698c3078887bca5067da905a4cf1c43840a8e7be57f23eed"}
Oct 30 02:56:57.493125 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:57.493096    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-67djd-htsft"]
Oct 30 02:56:57.496059 ip-10-0-136-202 kubenswrapper[4869]: W1030 02:56:57.496030    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d68c7b8_e4df_45e9_a72b_8e4238564647.slice/crio-1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33 WatchSource:0}: Error finding container 1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33: Status 404 returned error can't find the container with id 1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33
Oct 30 02:56:57.819196 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:56:57.819116    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:56:58.244080 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:58.244048    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-67djd-htsft" event={"ID":"8d68c7b8-e4df-45e9-a72b-8e4238564647","Type":"ContainerStarted","Data":"876ea8f60696b80966d490a6c9ba2a00a51e1ba9c4e19c8b6059e52ae21b3e54"}
Oct 30 02:56:58.244552 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:58.244110    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-67djd-htsft" event={"ID":"8d68c7b8-e4df-45e9-a72b-8e4238564647","Type":"ContainerStarted","Data":"1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33"}
Oct 30 02:56:58.283986 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:56:58.283942    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-67djd-htsft" podStartSLOduration=2.283929296 podStartE2EDuration="2.283929296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:56:58.283626511 +0000 UTC m=+87.605206230" watchObservedRunningTime="2026-10-30 02:56:58.283929296 +0000 UTC m=+87.605509014"
Oct 30 02:57:01.255983 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:57:01.255885    4869 generic.go:356] "Generic (PLEG): container finished" podID="defeb4c3-553f-4427-836a-72b5f1bbc0d4" containerID="d82f74f2ce65f1c6f7c213ad8d57bfbd91a777d6091567571aa84e2d021be66e" exitCode=0
Oct 30 02:57:01.255983 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:57:01.255955    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72" event={"ID":"defeb4c3-553f-4427-836a-72b5f1bbc0d4","Type":"ContainerDied","Data":"d82f74f2ce65f1c6f7c213ad8d57bfbd91a777d6091567571aa84e2d021be66e"}
Oct 30 02:57:01.256400 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:57:01.256261    4869 scope.go:122] "RemoveContainer" containerID="d82f74f2ce65f1c6f7c213ad8d57bfbd91a777d6091567571aa84e2d021be66e"
Oct 30 02:57:02.261628 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:57:02.261590    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-64w72" event={"ID":"defeb4c3-553f-4427-836a-72b5f1bbc0d4","Type":"ContainerStarted","Data":"a6d6baadbd01d843b5b3a620f3c8c9b2aabb6fe3bb71241108d4098806c77d5f"}
Oct 30 02:57:27.819476 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:57:27.819437    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:57:57.819256 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:57:57.819175    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:58:21.561275 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:21.561245    4869 generic.go:356] "Generic (PLEG): container finished" podID="8d68c7b8-e4df-45e9-a72b-8e4238564647" containerID="876ea8f60696b80966d490a6c9ba2a00a51e1ba9c4e19c8b6059e52ae21b3e54" exitCode=0
Oct 30 02:58:21.561764 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:21.561288    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-67djd-htsft" event={"ID":"8d68c7b8-e4df-45e9-a72b-8e4238564647","Type":"ContainerDied","Data":"876ea8f60696b80966d490a6c9ba2a00a51e1ba9c4e19c8b6059e52ae21b3e54"}
Oct 30 02:58:22.698649 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.698627    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:58:22.833376 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833317    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\" (UniqueName: \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\") pod \"8d68c7b8-e4df-45e9-a72b-8e4238564647\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") "
Oct 30 02:58:22.833506 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833397    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\") pod \"8d68c7b8-e4df-45e9-a72b-8e4238564647\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") "
Oct 30 02:58:22.833506 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833430    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\") pod \"8d68c7b8-e4df-45e9-a72b-8e4238564647\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") "
Oct 30 02:58:22.833506 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833468    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\") pod \"8d68c7b8-e4df-45e9-a72b-8e4238564647\" (UID: \"8d68c7b8-e4df-45e9-a72b-8e4238564647\") "
Oct 30 02:58:22.833776 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833747    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path" pod "8d68c7b8-e4df-45e9-a72b-8e4238564647" (UID: "8d68c7b8-e4df-45e9-a72b-8e4238564647"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:58:22.833814 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833753    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle" pod "8d68c7b8-e4df-45e9-a72b-8e4238564647" (UID: "8d68c7b8-e4df-45e9-a72b-8e4238564647"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:58:22.833847 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.833825    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle" pod "8d68c7b8-e4df-45e9-a72b-8e4238564647" (UID: "8d68c7b8-e4df-45e9-a72b-8e4238564647"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:58:22.835238 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.835219    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54" pod "8d68c7b8-e4df-45e9-a72b-8e4238564647" (UID: "8d68c7b8-e4df-45e9-a72b-8e4238564647"). InnerVolumeSpecName "kube-api-access-sqq54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:58:22.934871 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.934844    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqq54\" (UniqueName: \"kubernetes.io/projected/8d68c7b8-e4df-45e9-a72b-8e4238564647-kube-api-access-sqq54\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:58:22.934871 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.934871    4869 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-trusted-ca-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:58:22.935067 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.934885    4869 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8d68c7b8-e4df-45e9-a72b-8e4238564647-archives-path\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:58:22.935067 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:22.934899    4869 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d68c7b8-e4df-45e9-a72b-8e4238564647-service-ca-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 02:58:23.569863 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:23.569837    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-67djd-htsft"
Oct 30 02:58:23.569863 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:23.569854    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-67djd-htsft" event={"ID":"8d68c7b8-e4df-45e9-a72b-8e4238564647","Type":"ContainerDied","Data":"1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33"}
Oct 30 02:58:23.570087 ip-10-0-136-202 kubenswrapper[4869]: I1030 02:58:23.569897    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1788dfe46ddfc147d9afb0f637d59bbe281701782b9b04c77c34a11c4b1e4b33"
Oct 30 02:58:27.819055 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:58:27.819020    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:58:57.818538 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:58:57.818502    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:59:27.820246 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:59:27.820212    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 02:59:57.820628 ip-10-0-136-202 kubenswrapper[4869]: E1030 02:59:57.820570    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:00:27.819655 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:00:27.819617    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:00:30.838338 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:00:30.838310    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:00:30.840437 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:00:30.840413    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:00:57.820092 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:00:57.820018    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:01:27.819639 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:01:27.819567    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:01:57.818778 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:01:57.818740    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:02:27.820970 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:02:27.820931    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:02:57.818560 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:02:57.818524    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:03:27.821440 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:03:27.821401    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:03:57.819653 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:03:57.819561    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:04:27.819690 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:04:27.819655    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:04:57.822545 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:04:57.822430    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:05:27.819161 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:05:27.819127    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:05:30.864065 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:05:30.864037    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:05:30.868229 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:05:30.868210    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:05:57.818946 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:05:57.818912    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:06:27.818875 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:06:27.818838    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:06:57.820128 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:06:57.820052    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:07:27.819280 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:07:27.819243    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:07:57.819157 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:07:57.819118    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:08:27.819234 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:08:27.819197    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:08:57.820294 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:08:57.820255    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:09:27.820031 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:09:27.819992    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:09:44.117399 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.117324    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"]
Oct 30 03:09:44.118096 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.117628    4869 cpu_manager.go:414] "containerMap: removing container" podUID="8d68c7b8-e4df-45e9-a72b-8e4238564647" containerName="insights-gathering"
Oct 30 03:09:44.118096 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.117641    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d68c7b8-e4df-45e9-a72b-8e4238564647" containerName="insights-gathering"
Oct 30 03:09:44.118096 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.117704    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d68c7b8-e4df-45e9-a72b-8e4238564647" containerName="insights-gathering"
Oct 30 03:09:44.120757 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.120737    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.146690 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.146671    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 03:09:44.146820 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.146809    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 03:09:44.146877 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.146832    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-rf78h\""
Oct 30 03:09:44.157191 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.157167    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"]
Oct 30 03:09:44.191290 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.191267    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.191375 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.191303    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98t5d\" (UniqueName: \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.191375 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.191324    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.292449 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.292419    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.292542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.292457    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98t5d\" (UniqueName: \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.292542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.292478    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.292790 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.292771    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.292865 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.292848    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.315635 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.315610    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98t5d\" (UniqueName: \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.449908 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.449888    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:09:44.743948 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.743923    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"]
Oct 30 03:09:44.746345 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:09:44.746309    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00f71f5_46b9_4a9d_98e9_c05fe1549274.slice/crio-12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04 WatchSource:0}: Error finding container 12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04: Status 404 returned error can't find the container with id 12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04
Oct 30 03:09:44.748164 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:44.748151    4869 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:09:45.024896 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:45.024826    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9" event={"ID":"f00f71f5-46b9-4a9d-98e9-c05fe1549274","Type":"ContainerStarted","Data":"12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04"}
Oct 30 03:09:51.048761 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:51.048720    4869 generic.go:356] "Generic (PLEG): container finished" podID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerID="379a40260cf3b9eea966d8df34b8d38b1db5cbf490de9efe5fee9d6773d392ba" exitCode=0
Oct 30 03:09:51.049204 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:51.048813    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9" event={"ID":"f00f71f5-46b9-4a9d-98e9-c05fe1549274","Type":"ContainerDied","Data":"379a40260cf3b9eea966d8df34b8d38b1db5cbf490de9efe5fee9d6773d392ba"}
Oct 30 03:09:54.062692 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:54.062662    4869 generic.go:356] "Generic (PLEG): container finished" podID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerID="d602ac36e0ca8dcf0b50a779a87f86f5c3962ef602ab11825104e705577fc3d3" exitCode=0
Oct 30 03:09:54.063076 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:09:54.062736    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9" event={"ID":"f00f71f5-46b9-4a9d-98e9-c05fe1549274","Type":"ContainerDied","Data":"d602ac36e0ca8dcf0b50a779a87f86f5c3962ef602ab11825104e705577fc3d3"}
Oct 30 03:09:57.821674 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:09:57.821624    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:10:00.087722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:00.087687    4869 generic.go:356] "Generic (PLEG): container finished" podID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerID="577838bb93dfd69a4a2673c1b25921e790eb30491c6fb406ce7d7ef250e84f2c" exitCode=0
Oct 30 03:10:00.088119 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:00.087769    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9" event={"ID":"f00f71f5-46b9-4a9d-98e9-c05fe1549274","Type":"ContainerDied","Data":"577838bb93dfd69a4a2673c1b25921e790eb30491c6fb406ce7d7ef250e84f2c"}
Oct 30 03:10:01.213595 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.213556    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:10:01.323033 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.323003    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\" (UniqueName: \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\") pod \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") "
Oct 30 03:10:01.323156 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.323076    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\") pod \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") "
Oct 30 03:10:01.323156 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.323144    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\") pod \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\" (UID: \"f00f71f5-46b9-4a9d-98e9-c05fe1549274\") "
Oct 30 03:10:01.323707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.323682    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle" pod "f00f71f5-46b9-4a9d-98e9-c05fe1549274" (UID: "f00f71f5-46b9-4a9d-98e9-c05fe1549274"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:10:01.325209 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.325180    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d" pod "f00f71f5-46b9-4a9d-98e9-c05fe1549274" (UID: "f00f71f5-46b9-4a9d-98e9-c05fe1549274"). InnerVolumeSpecName "kube-api-access-98t5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:10:01.327657 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.327638    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util" pod "f00f71f5-46b9-4a9d-98e9-c05fe1549274" (UID: "f00f71f5-46b9-4a9d-98e9-c05fe1549274"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:10:01.423814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.423760    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:10:01.423814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.423784    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98t5d\" (UniqueName: \"kubernetes.io/projected/f00f71f5-46b9-4a9d-98e9-c05fe1549274-kube-api-access-98t5d\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:10:01.423814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:01.423794    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f00f71f5-46b9-4a9d-98e9-c05fe1549274-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:10:02.097573 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:02.097539    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9" event={"ID":"f00f71f5-46b9-4a9d-98e9-c05fe1549274","Type":"ContainerDied","Data":"12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04"}
Oct 30 03:10:02.097573 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:02.097557    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c4jlx9"
Oct 30 03:10:02.097792 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:02.097606    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12260a0ce059c256f07c6e6f113c16fe3f0f20902ff4f10bbf24f5a3e9450f04"
Oct 30 03:10:07.281737 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.281698    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"]
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.281980    4869 cpu_manager.go:414] "containerMap: removing container" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="util"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.281991    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="util"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.282019    4869 cpu_manager.go:414] "containerMap: removing container" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="pull"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.282024    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="pull"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.282034    4869 cpu_manager.go:414] "containerMap: removing container" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="extract"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.282039    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="extract"
Oct 30 03:10:07.282135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.282091    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="f00f71f5-46b9-4a9d-98e9-c05fe1549274" containerName="extract"
Oct 30 03:10:07.284092 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.284071    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.298402 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.298375    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Oct 30 03:10:07.298543 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.298491    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Oct 30 03:10:07.298543 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.298499    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Oct 30 03:10:07.309994 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.309969    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-dq4xw\""
Oct 30 03:10:07.312205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.312180    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"]
Oct 30 03:10:07.468631 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.468608    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2782ff08-d623-458a-8830-3528db15ec08-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.468733 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.468636    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7vj\" (UniqueName: \"kubernetes.io/projected/2782ff08-d623-458a-8830-3528db15ec08-kube-api-access-zg7vj\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.568923 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.568866    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2782ff08-d623-458a-8830-3528db15ec08-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.568923 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.568901    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7vj\" (UniqueName: \"kubernetes.io/projected/2782ff08-d623-458a-8830-3528db15ec08-kube-api-access-zg7vj\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.571177 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.571156    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2782ff08-d623-458a-8830-3528db15ec08-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.591884 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.591855    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7vj\" (UniqueName: \"kubernetes.io/projected/2782ff08-d623-458a-8830-3528db15ec08-kube-api-access-zg7vj\") pod \"custom-metrics-autoscaler-operator-c667576c8-vrm9p\" (UID: \"2782ff08-d623-458a-8830-3528db15ec08\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.596642 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.596619    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:07.925691 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:07.925669    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"]
Oct 30 03:10:07.928251 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:10:07.928219    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2782ff08_d623_458a_8830_3528db15ec08.slice/crio-f7f9a894084fda9674288670e2224875c48936d515aea88227ccb92e05ab91e8 WatchSource:0}: Error finding container f7f9a894084fda9674288670e2224875c48936d515aea88227ccb92e05ab91e8: Status 404 returned error can't find the container with id f7f9a894084fda9674288670e2224875c48936d515aea88227ccb92e05ab91e8
Oct 30 03:10:08.119141 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:08.119113    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p" event={"ID":"2782ff08-d623-458a-8830-3528db15ec08","Type":"ContainerStarted","Data":"f7f9a894084fda9674288670e2224875c48936d515aea88227ccb92e05ab91e8"}
Oct 30 03:10:12.140196 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:12.140161    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p" event={"ID":"2782ff08-d623-458a-8830-3528db15ec08","Type":"ContainerStarted","Data":"8134f1af30a4ae917edf968b6483d4eeb0dca1503d66488f583c798553b1fe3a"}
Oct 30 03:10:12.140632 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:12.140280    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:12.209134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:12.209085    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p" podStartSLOduration=1.6385198060000001 podStartE2EDuration="5.209073503s" totalImagesPullingTime="3.570553697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:10:12.196214694 +0000 UTC m=+881.517794412" watchObservedRunningTime="2026-10-30 03:10:12.209073503 +0000 UTC m=+881.530653222"
Oct 30 03:10:13.000862 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.000830    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-ffjlz"]
Oct 30 03:10:13.003135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.003118    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.017653 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.017632    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Oct 30 03:10:13.017830 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.017814    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8g7mn\""
Oct 30 03:10:13.029194 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.029172    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Oct 30 03:10:13.030208 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.030188    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-ffjlz"]
Oct 30 03:10:13.112420 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.112396    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11fed8b5-ad26-4eba-837f-f32bc95b859c-cabundle0\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.112516 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.112450    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js2dp\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-kube-api-access-js2dp\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.112556 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.112523    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.212867 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.212842    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js2dp\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-kube-api-access-js2dp\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.212881    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.213013    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11fed8b5-ad26-4eba-837f-f32bc95b859c-cabundle0\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:13.213036    4869 secret.go:281] references non-existent secret key: ca.crt
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:13.213054    4869 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:13.213065    4869 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-ffjlz: references non-existent secret key: ca.crt
Oct 30 03:10:13.213268 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:13.213129    4869 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates podName:11fed8b5-ad26-4eba-837f-f32bc95b859c nodeName:}" failed. No retries permitted until 2026-10-30 03:10:13.713108971 +0000 UTC m=+883.034688766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates") pod "keda-operator-7dc85965f-ffjlz" (UID: "11fed8b5-ad26-4eba-837f-f32bc95b859c") : references non-existent secret key: ca.crt
Oct 30 03:10:13.213807 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.213788    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11fed8b5-ad26-4eba-837f-f32bc95b859c-cabundle0\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.237965 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.237939    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js2dp\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-kube-api-access-js2dp\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.718277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.718239    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.720534 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.720512    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11fed8b5-ad26-4eba-837f-f32bc95b859c-certificates\") pod \"keda-operator-7dc85965f-ffjlz\" (UID: \"11fed8b5-ad26-4eba-837f-f32bc95b859c\") " pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:13.915017 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:13.914982    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:14.208996 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:14.208863    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-ffjlz"]
Oct 30 03:10:14.211008 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:10:14.210981    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fed8b5_ad26_4eba_837f_f32bc95b859c.slice/crio-ec00b00e7bf4a47e28dfcb3ec908393ff49a7a98844940468e419a2c2dad60a4 WatchSource:0}: Error finding container ec00b00e7bf4a47e28dfcb3ec908393ff49a7a98844940468e419a2c2dad60a4: Status 404 returned error can't find the container with id ec00b00e7bf4a47e28dfcb3ec908393ff49a7a98844940468e419a2c2dad60a4
Oct 30 03:10:15.154430 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:15.154383    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-ffjlz" event={"ID":"11fed8b5-ad26-4eba-837f-f32bc95b859c","Type":"ContainerStarted","Data":"ec00b00e7bf4a47e28dfcb3ec908393ff49a7a98844940468e419a2c2dad60a4"}
Oct 30 03:10:18.168173 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:18.168137    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-ffjlz" event={"ID":"11fed8b5-ad26-4eba-837f-f32bc95b859c","Type":"ContainerStarted","Data":"cd17607f0d4dd633c7912681f4c20f6f50d9268103381223c01dddad6bfeaab3"}
Oct 30 03:10:18.168694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:18.168364    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:27.819682 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:27.819642    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:10:30.888293 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:30.888257    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:10:30.893426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:30.893398    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:10:33.146266 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:33.146233    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-vrm9p"
Oct 30 03:10:33.212708 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:33.212663    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-ffjlz" podStartSLOduration=18.077274412 podStartE2EDuration="21.21265125s" totalImagesPullingTime="3.135376838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:10:18.208421939 +0000 UTC m=+887.530001657" watchObservedRunningTime="2026-10-30 03:10:33.21265125 +0000 UTC m=+902.534230966"
Oct 30 03:10:39.175042 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:10:39.175012    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-ffjlz"
Oct 30 03:10:57.818888 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:10:57.818854    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:11:08.265139 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.265106    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"]
Oct 30 03:11:08.269362 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.269344    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.295412 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.295388    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 03:11:08.295412 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.295395    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-52jx8\""
Oct 30 03:11:08.295553 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.295424    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 03:11:08.296743 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.296725    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"]
Oct 30 03:11:08.398137 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.398111    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.398279 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.398153    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7v2j\" (UniqueName: \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.398279 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.398173    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.499043 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.499009    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7v2j\" (UniqueName: \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.499186 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.499048    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.499186 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.499116    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.499468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.499448    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.499529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.499482    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.522355 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.522307    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7v2j\" (UniqueName: \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.582043 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.582021    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:08.874983 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:08.874956    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"]
Oct 30 03:11:08.877381 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:11:08.877354    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab67fb97_4767_4327_ae6f_5c0d717ded19.slice/crio-70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667 WatchSource:0}: Error finding container 70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667: Status 404 returned error can't find the container with id 70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667
Oct 30 03:11:09.368673 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:09.368638    4869 generic.go:356] "Generic (PLEG): container finished" podID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerID="81445ac2d3453d45fc32dbc4d45a39f837925fe14f511c09724956c51fef4a68" exitCode=0
Oct 30 03:11:09.369138 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:09.368731    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd" event={"ID":"ab67fb97-4767-4327-ae6f-5c0d717ded19","Type":"ContainerDied","Data":"81445ac2d3453d45fc32dbc4d45a39f837925fe14f511c09724956c51fef4a68"}
Oct 30 03:11:09.369138 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:09.368779    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd" event={"ID":"ab67fb97-4767-4327-ae6f-5c0d717ded19","Type":"ContainerStarted","Data":"70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667"}
Oct 30 03:11:12.384318 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:12.384275    4869 generic.go:356] "Generic (PLEG): container finished" podID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerID="4368c5d723de32ef1c260b5bbd2e77d2ec6632a08851a398db99bd3b37f240c1" exitCode=0
Oct 30 03:11:12.384763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:12.384374    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd" event={"ID":"ab67fb97-4767-4327-ae6f-5c0d717ded19","Type":"ContainerDied","Data":"4368c5d723de32ef1c260b5bbd2e77d2ec6632a08851a398db99bd3b37f240c1"}
Oct 30 03:11:13.390375 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:13.390300    4869 generic.go:356] "Generic (PLEG): container finished" podID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerID="59b253f5fb7c8e002b56ce879962c7ae234cefade5b85deff7e27a0da0b92c4f" exitCode=0
Oct 30 03:11:13.390735 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:13.390369    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd" event={"ID":"ab67fb97-4767-4327-ae6f-5c0d717ded19","Type":"ContainerDied","Data":"59b253f5fb7c8e002b56ce879962c7ae234cefade5b85deff7e27a0da0b92c4f"}
Oct 30 03:11:14.521498 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.521472    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:14.650104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.650052    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\" (UniqueName: \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\") pod \"ab67fb97-4767-4327-ae6f-5c0d717ded19\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") "
Oct 30 03:11:14.650104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.650100    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\") pod \"ab67fb97-4767-4327-ae6f-5c0d717ded19\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") "
Oct 30 03:11:14.650257 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.650218    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\") pod \"ab67fb97-4767-4327-ae6f-5c0d717ded19\" (UID: \"ab67fb97-4767-4327-ae6f-5c0d717ded19\") "
Oct 30 03:11:14.650911 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.650889    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle" pod "ab67fb97-4767-4327-ae6f-5c0d717ded19" (UID: "ab67fb97-4767-4327-ae6f-5c0d717ded19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:11:14.652066 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.652038    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j" pod "ab67fb97-4767-4327-ae6f-5c0d717ded19" (UID: "ab67fb97-4767-4327-ae6f-5c0d717ded19"). InnerVolumeSpecName "kube-api-access-w7v2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:11:14.655585 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.655539    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util" pod "ab67fb97-4767-4327-ae6f-5c0d717ded19" (UID: "ab67fb97-4767-4327-ae6f-5c0d717ded19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:11:14.751694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.751669    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:14.751694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.751688    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7v2j\" (UniqueName: \"kubernetes.io/projected/ab67fb97-4767-4327-ae6f-5c0d717ded19-kube-api-access-w7v2j\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:14.751837 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:14.751700    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab67fb97-4767-4327-ae6f-5c0d717ded19-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:15.400722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:15.400692    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd"
Oct 30 03:11:15.400879 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:15.400689    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cc6mtd" event={"ID":"ab67fb97-4767-4327-ae6f-5c0d717ded19","Type":"ContainerDied","Data":"70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667"}
Oct 30 03:11:15.400879 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:15.400812    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70910ba602f34c356165ce8b8c666c43dd15de207d905d13642e5de305ea2667"
Oct 30 03:11:22.758045 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758009    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"]
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758284    4869 cpu_manager.go:414] "containerMap: removing container" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="util"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758295    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="util"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758309    4869 cpu_manager.go:414] "containerMap: removing container" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="pull"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758314    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="pull"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758325    4869 cpu_manager.go:414] "containerMap: removing container" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="extract"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758330    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="extract"
Oct 30 03:11:22.758426 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.758384    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab67fb97-4767-4327-ae6f-5c0d717ded19" containerName="extract"
Oct 30 03:11:22.763852 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.763834    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:22.775408 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.775381    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"]
Oct 30 03:11:22.785739 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.785711    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 03:11:22.785739 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.785711    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 03:11:22.785739 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.785714    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fbr5x\""
Oct 30 03:11:22.911365 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.911332    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnpf\" (UniqueName: \"kubernetes.io/projected/ccf245cb-9236-4716-9c72-44904c1596ec-kube-api-access-jfnpf\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:22.911532 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:22.911382    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf245cb-9236-4716-9c72-44904c1596ec-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.012004 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.011934    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnpf\" (UniqueName: \"kubernetes.io/projected/ccf245cb-9236-4716-9c72-44904c1596ec-kube-api-access-jfnpf\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.012004 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.011982    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf245cb-9236-4716-9c72-44904c1596ec-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.012384 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.012361    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf245cb-9236-4716-9c72-44904c1596ec-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.055312 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.055284    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnpf\" (UniqueName: \"kubernetes.io/projected/ccf245cb-9236-4716-9c72-44904c1596ec-kube-api-access-jfnpf\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dp72m\" (UID: \"ccf245cb-9236-4716-9c72-44904c1596ec\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.075085 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.075064    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"
Oct 30 03:11:23.399031 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.398991    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m"]
Oct 30 03:11:23.401681 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:11:23.401653    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf245cb_9236_4716_9c72_44904c1596ec.slice/crio-19be98c3a0c29aea9a7972561be388b1e806f503524d67d4327bdccecdc1ba4e WatchSource:0}: Error finding container 19be98c3a0c29aea9a7972561be388b1e806f503524d67d4327bdccecdc1ba4e: Status 404 returned error can't find the container with id 19be98c3a0c29aea9a7972561be388b1e806f503524d67d4327bdccecdc1ba4e
Oct 30 03:11:23.436120 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:23.436092    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m" event={"ID":"ccf245cb-9236-4716-9c72-44904c1596ec","Type":"ContainerStarted","Data":"19be98c3a0c29aea9a7972561be388b1e806f503524d67d4327bdccecdc1ba4e"}
Oct 30 03:11:25.447603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:25.447534    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m" event={"ID":"ccf245cb-9236-4716-9c72-44904c1596ec","Type":"ContainerStarted","Data":"e57d6693670860cf676b7bf761341753b3091816a9bb6a08e01dc2da7cdbbdf6"}
Oct 30 03:11:25.519877 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:25.519826    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dp72m" podStartSLOduration=2.201268918 podStartE2EDuration="3.519802587s" totalImagesPullingTime="1.318533669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:11:25.518386372 +0000 UTC m=+954.839966092" watchObservedRunningTime="2026-10-30 03:11:25.519802587 +0000 UTC m=+954.841382307"
Oct 30 03:11:27.818159 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:11:27.818128    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:11:34.059793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.059752    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"]
Oct 30 03:11:34.063456 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.063439    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.089515 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.089482    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 03:11:34.089515 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.089490    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 03:11:34.089719 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.089562    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"61b1ff68c7255ee5c5329fe19a5d96293a9578-ce91a85d-dockercfg-zxhc9\""
Oct 30 03:11:34.090790 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.090766    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"]
Oct 30 03:11:34.189104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.189079    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.189220 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.189122    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.189220 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.189154    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d76fb\" (UniqueName: \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.289658 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.289634    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.289753 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.289665    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.289753 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.289689    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d76fb\" (UniqueName: \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.290060 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.290040    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.290127 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.290053    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.314624 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.314544    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d76fb\" (UniqueName: \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.379642 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.379619    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:34.675336 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.675312    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"]
Oct 30 03:11:34.677745 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:11:34.677710    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839c7f7b_21e0_4bcf_acd6_c209454fc5eb.slice/crio-f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c WatchSource:0}: Error finding container f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c: Status 404 returned error can't find the container with id f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c
Oct 30 03:11:34.746686 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.746654    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"]
Oct 30 03:11:34.749747 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.749727    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:34.764283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.764265    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zjvw8\""
Oct 30 03:11:34.770336 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.770311    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 03:11:34.770336 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.770322    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 03:11:34.776971 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.776949    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"]
Oct 30 03:11:34.894712 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.894684    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:34.894817 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.894731    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5kl6\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-kube-api-access-j5kl6\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:34.995924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.995901    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:34.996023 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:34.995936    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5kl6\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-kube-api-access-j5kl6\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:35.018702 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.018676    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:35.018785 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.018741    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5kl6\" (UniqueName: \"kubernetes.io/projected/2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd-kube-api-access-j5kl6\") pod \"cert-manager-webhook-5dbbbf75cc-8xr2h\" (UID: \"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:35.073711 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.073689    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:35.365420 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.365289    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"]
Oct 30 03:11:35.368129 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:11:35.368099    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e5e4cb3_e51a_4b2c_bae7_10e74439d1bd.slice/crio-4a335ca459c8a0a384b9bbf009eedd93ff050964308e5fce85baead417ab2a8d WatchSource:0}: Error finding container 4a335ca459c8a0a384b9bbf009eedd93ff050964308e5fce85baead417ab2a8d: Status 404 returned error can't find the container with id 4a335ca459c8a0a384b9bbf009eedd93ff050964308e5fce85baead417ab2a8d
Oct 30 03:11:35.487642 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.487618    4869 generic.go:356] "Generic (PLEG): container finished" podID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerID="1b15d3b154c58f444e0a408d4007d1bf9592022a7f65bee96f8e4301c7e4cca8" exitCode=0
Oct 30 03:11:35.487748 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.487692    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr" event={"ID":"839c7f7b-21e0-4bcf-acd6-c209454fc5eb","Type":"ContainerDied","Data":"1b15d3b154c58f444e0a408d4007d1bf9592022a7f65bee96f8e4301c7e4cca8"}
Oct 30 03:11:35.487748 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.487735    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr" event={"ID":"839c7f7b-21e0-4bcf-acd6-c209454fc5eb","Type":"ContainerStarted","Data":"f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c"}
Oct 30 03:11:35.488997 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:35.488968    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h" event={"ID":"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd","Type":"ContainerStarted","Data":"4a335ca459c8a0a384b9bbf009eedd93ff050964308e5fce85baead417ab2a8d"}
Oct 30 03:11:37.500391 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:37.500329    4869 generic.go:356] "Generic (PLEG): container finished" podID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerID="c68659f7f3ec10826e0a2f63fc3a3a32aba7b96242b3f1bfe3a0f4b8ce454499" exitCode=0
Oct 30 03:11:37.500734 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:37.500413    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr" event={"ID":"839c7f7b-21e0-4bcf-acd6-c209454fc5eb","Type":"ContainerDied","Data":"c68659f7f3ec10826e0a2f63fc3a3a32aba7b96242b3f1bfe3a0f4b8ce454499"}
Oct 30 03:11:38.507895 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:38.507863    4869 generic.go:356] "Generic (PLEG): container finished" podID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerID="e9468193bdbd529c143a630f07902dd21f35fde73b9927d992de04665ac07ecb" exitCode=0
Oct 30 03:11:38.508307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:38.507951    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr" event={"ID":"839c7f7b-21e0-4bcf-acd6-c209454fc5eb","Type":"ContainerDied","Data":"e9468193bdbd529c143a630f07902dd21f35fde73b9927d992de04665ac07ecb"}
Oct 30 03:11:39.514244 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.514216    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h" event={"ID":"2e5e4cb3-e51a-4b2c-bae7-10e74439d1bd","Type":"ContainerStarted","Data":"3e2e694e70d23f312752278503975f3ce9c143f1af04e9682da30ec66eb094cb"}
Oct 30 03:11:39.514663 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.514358    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:39.555517 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.555457    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h" podStartSLOduration=1.873131491 podStartE2EDuration="5.555438263s" totalImagesPullingTime="3.682306772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:11:39.554274686 +0000 UTC m=+968.875854404" watchObservedRunningTime="2026-10-30 03:11:39.555438263 +0000 UTC m=+968.877017984"
Oct 30 03:11:39.636890 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.636867    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:39.732129 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.732102    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\") pod \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") "
Oct 30 03:11:39.732264 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.732142    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\" (UniqueName: \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\") pod \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") "
Oct 30 03:11:39.732264 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.732194    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\") pod \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\" (UID: \"839c7f7b-21e0-4bcf-acd6-c209454fc5eb\") "
Oct 30 03:11:39.732568 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.732545    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle" pod "839c7f7b-21e0-4bcf-acd6-c209454fc5eb" (UID: "839c7f7b-21e0-4bcf-acd6-c209454fc5eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:11:39.734127 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.734105    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb" pod "839c7f7b-21e0-4bcf-acd6-c209454fc5eb" (UID: "839c7f7b-21e0-4bcf-acd6-c209454fc5eb"). InnerVolumeSpecName "kube-api-access-d76fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:11:39.737356 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.737333    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util" pod "839c7f7b-21e0-4bcf-acd6-c209454fc5eb" (UID: "839c7f7b-21e0-4bcf-acd6-c209454fc5eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:11:39.833629 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.833566    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:39.833629 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.833600    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d76fb\" (UniqueName: \"kubernetes.io/projected/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-kube-api-access-d76fb\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:39.833629 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:39.833610    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839c7f7b-21e0-4bcf-acd6-c209454fc5eb-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:11:40.520883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:40.520857    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr"
Oct 30 03:11:40.520883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:40.520864    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85bqlwr" event={"ID":"839c7f7b-21e0-4bcf-acd6-c209454fc5eb","Type":"ContainerDied","Data":"f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c"}
Oct 30 03:11:40.521379 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:40.520926    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f84ad1e5b5e5b1d98118c08ae0bc659e92fcfc0a936ee3c4b68f7a0c58b1e79c"
Oct 30 03:11:45.523969 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:11:45.523930    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8xr2h"
Oct 30 03:11:57.820221 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:11:57.820182    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:12:04.443434 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443402    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443724    4869 cpu_manager.go:414] "containerMap: removing container" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="pull"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443735    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="pull"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443745    4869 cpu_manager.go:414] "containerMap: removing container" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="util"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443750    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="util"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443759    4869 cpu_manager.go:414] "containerMap: removing container" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="extract"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443764    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="extract"
Oct 30 03:12:04.443823 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.443816    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="839c7f7b-21e0-4bcf-acd6-c209454fc5eb" containerName="extract"
Oct 30 03:12:04.446800 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.446780    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.461450 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.461423    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 03:12:04.461450 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.461431    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 03:12:04.461450 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.461442    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 03:12:04.461450 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.461440    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lqpq7\""
Oct 30 03:12:04.461663 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.461426    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 03:12:04.474357 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.474335    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:12:04.496950 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.496926    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497047 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.496956    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497047 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.496974    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497171 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.497079    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.497195    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.497213    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9shl\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.497303 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.497230    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598249 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598225    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598355 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598256    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598355 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598274    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598355 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598294    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598514 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598424    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598514 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598475    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.598514 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.598503    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9shl\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.599104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.599077    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.600702 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.600680    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.600814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.600794    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.600880 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.600865    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.601091 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.601069    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.620883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.620856    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9shl\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.621085 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.621063    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-b25rs\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:04.758234 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:04.758185    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:05.068085 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:05.068065    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:12:05.070339 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:05.070308    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9692c49a_1dfb_4204_b07f_e4fbe0d6d6b0.slice/crio-be47ecd99cd21d53b1a3166a2df5f97af050dec90d57aaa025990445371fdbeb WatchSource:0}: Error finding container be47ecd99cd21d53b1a3166a2df5f97af050dec90d57aaa025990445371fdbeb: Status 404 returned error can't find the container with id be47ecd99cd21d53b1a3166a2df5f97af050dec90d57aaa025990445371fdbeb
Oct 30 03:12:05.633196 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:05.633160    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" event={"ID":"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0","Type":"ContainerStarted","Data":"be47ecd99cd21d53b1a3166a2df5f97af050dec90d57aaa025990445371fdbeb"}
Oct 30 03:12:07.570475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:07.570440    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:12:07.570804 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:07.570503    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:12:07.644330 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:07.644302    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" event={"ID":"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0","Type":"ContainerStarted","Data":"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"}
Oct 30 03:12:07.644451 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:07.644437    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:07.709363 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:07.709310    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" podStartSLOduration=1.211745111 podStartE2EDuration="3.709297714s" totalImagesPullingTime="2.497552603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:07.697003649 +0000 UTC m=+997.018583368" watchObservedRunningTime="2026-10-30 03:12:07.709297714 +0000 UTC m=+997.030877432"
Oct 30 03:12:08.649974 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:08.649938    4869 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-b25rs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 03:12:08.650338 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:08.650014    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:12:11.649905 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:11.649868    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:12:20.427938 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.427901    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"]
Oct 30 03:12:20.430482 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.430455    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.459036 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.459008    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 03:12:20.459036 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.459012    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 03:12:20.459234 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.459037    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-c5mcj\""
Oct 30 03:12:20.460631 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.460610    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"]
Oct 30 03:12:20.486655 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.486634    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"]
Oct 30 03:12:20.488844 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.488829    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.505099 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.505078    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-55hpm\""
Oct 30 03:12:20.511027 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.511002    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"]
Oct 30 03:12:20.517806 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517783    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.517806 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517812    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.517979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517851    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.517979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517898    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cknm9\" (UniqueName: \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.517979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517919    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522k7\" (UniqueName: \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.517979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.517933    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.579441 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.579418    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"]
Oct 30 03:12:20.581680 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.581665    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.595495 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.595474    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-r5ksz\""
Oct 30 03:12:20.602809 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.602786    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"]
Oct 30 03:12:20.618776 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.618756    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.618861 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.618782    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.618861 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.618804    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.618944 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.618925    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l984f\" (UniqueName: \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.618985 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.618971    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.619126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619105    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.619126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619119    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.619193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619147    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cknm9\" (UniqueName: \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.619193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619175    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-522k7\" (UniqueName: \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.619258 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619200    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.619258 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619213    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.619371 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619352    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.619467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.619450    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.641922 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.641898    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522k7\" (UniqueName: \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.642015 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.641946    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cknm9\" (UniqueName: \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.679214 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.679165    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"]
Oct 30 03:12:20.681750 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.681736    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.695773 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.695747    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-7kj64\""
Oct 30 03:12:20.706255 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.706235    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"]
Oct 30 03:12:20.720198 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720171    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.720300 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720212    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.720363 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720332    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzl9\" (UniqueName: \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.720415 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720361    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.720415 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720388    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l984f\" (UniqueName: \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.720500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720456    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.720784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720764    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.720832 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.720818    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.743567 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.743549    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:20.743997 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.743977    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l984f\" (UniqueName: \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.801227 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.800981    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:20.821760 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.821734    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzl9\" (UniqueName: \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.821873 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.821783    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.822089 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.822068    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.822175 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.822107    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.822338 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.822324    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.844971 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.844946    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzl9\" (UniqueName: \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:20.893913 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.893884    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:20.994660 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:20.994630    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:21.038643 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.038517    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"]
Oct 30 03:12:21.041327 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:21.041172    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a91b2a4_32ed_4d45_9887_deac61cb61f1.slice/crio-cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff WatchSource:0}: Error finding container cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff: Status 404 returned error can't find the container with id cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff
Oct 30 03:12:21.102304 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.102282    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"]
Oct 30 03:12:21.104480 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:21.104455    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1cbcaf_ee16_4f2b_b0ef_bd775f089968.slice/crio-db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8 WatchSource:0}: Error finding container db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8: Status 404 returned error can't find the container with id db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8
Oct 30 03:12:21.188681 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.188655    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"]
Oct 30 03:12:21.250281 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:21.250251    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d630c78_9eea_488d_bb5d_e712dfb34f5f.slice/crio-71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce WatchSource:0}: Error finding container 71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce: Status 404 returned error can't find the container with id 71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce
Oct 30 03:12:21.286816 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.286685    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"]
Oct 30 03:12:21.289075 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:21.289047    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a34ae3_8946_46f7_a6a1_1db9ffe132f7.slice/crio-1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9 WatchSource:0}: Error finding container 1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9: Status 404 returned error can't find the container with id 1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9
Oct 30 03:12:21.705950 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.705918    4869 generic.go:356] "Generic (PLEG): container finished" podID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerID="8dccc9ed7004d3851c9d865e96072bcd5b30fd370756c5cea313c60c0d969ff2" exitCode=0
Oct 30 03:12:21.706339 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.705991    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9" event={"ID":"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7","Type":"ContainerDied","Data":"8dccc9ed7004d3851c9d865e96072bcd5b30fd370756c5cea313c60c0d969ff2"}
Oct 30 03:12:21.706339 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.706032    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9" event={"ID":"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7","Type":"ContainerStarted","Data":"1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9"}
Oct 30 03:12:21.707662 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.707636    4869 generic.go:356] "Generic (PLEG): container finished" podID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerID="7cea0a5ab587d871f8118c980c6f9d74c6ed2a99c779f6b2207405f6044449fb" exitCode=0
Oct 30 03:12:21.707760 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.707726    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np" event={"ID":"3d630c78-9eea-488d-bb5d-e712dfb34f5f","Type":"ContainerDied","Data":"7cea0a5ab587d871f8118c980c6f9d74c6ed2a99c779f6b2207405f6044449fb"}
Oct 30 03:12:21.707833 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.707778    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np" event={"ID":"3d630c78-9eea-488d-bb5d-e712dfb34f5f","Type":"ContainerStarted","Data":"71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce"}
Oct 30 03:12:21.709443 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.709388    4869 generic.go:356] "Generic (PLEG): container finished" podID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerID="8d90ae122d42263f9378591c8452b059afbfd48d731431aaa1c00499d732c4fc" exitCode=0
Oct 30 03:12:21.709509 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.709474    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj" event={"ID":"5a91b2a4-32ed-4d45-9887-deac61cb61f1","Type":"ContainerDied","Data":"8d90ae122d42263f9378591c8452b059afbfd48d731431aaa1c00499d732c4fc"}
Oct 30 03:12:21.709557 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.709533    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj" event={"ID":"5a91b2a4-32ed-4d45-9887-deac61cb61f1","Type":"ContainerStarted","Data":"cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff"}
Oct 30 03:12:21.711170 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.711062    4869 generic.go:356] "Generic (PLEG): container finished" podID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerID="72ed3c284dfb1c2ce30350c0b42ca6efa9a374030806b97497e86df65dfaa243" exitCode=0
Oct 30 03:12:21.711170 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.711125    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm" event={"ID":"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968","Type":"ContainerDied","Data":"72ed3c284dfb1c2ce30350c0b42ca6efa9a374030806b97497e86df65dfaa243"}
Oct 30 03:12:21.711170 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:21.711154    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm" event={"ID":"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968","Type":"ContainerStarted","Data":"db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8"}
Oct 30 03:12:22.721286 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.721258    4869 generic.go:356] "Generic (PLEG): container finished" podID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerID="585c555fd97933da0a344544f3a300c30123186f8e5739ffca0f279f7a52d531" exitCode=0
Oct 30 03:12:22.721609 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.721336    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm" event={"ID":"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968","Type":"ContainerDied","Data":"585c555fd97933da0a344544f3a300c30123186f8e5739ffca0f279f7a52d531"}
Oct 30 03:12:22.723378 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.723357    4869 generic.go:356] "Generic (PLEG): container finished" podID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerID="ab117f9b0fbb25bad3f04fe91154223f807ba4ce92b1cb624165a149577d10d0" exitCode=0
Oct 30 03:12:22.723478 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.723441    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9" event={"ID":"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7","Type":"ContainerDied","Data":"ab117f9b0fbb25bad3f04fe91154223f807ba4ce92b1cb624165a149577d10d0"}
Oct 30 03:12:22.725320 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.725299    4869 generic.go:356] "Generic (PLEG): container finished" podID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerID="5f82b2f836c1f8cdb9c3f30a85e06c8c7bc0be76eb117d17e1425efa1520f4b6" exitCode=0
Oct 30 03:12:22.725410 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.725354    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np" event={"ID":"3d630c78-9eea-488d-bb5d-e712dfb34f5f","Type":"ContainerDied","Data":"5f82b2f836c1f8cdb9c3f30a85e06c8c7bc0be76eb117d17e1425efa1520f4b6"}
Oct 30 03:12:22.727141 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.727118    4869 generic.go:356] "Generic (PLEG): container finished" podID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerID="99fd908530f86b8ca244869de8e9df06ce9ec2fe7f2b98723825a75a31b91f6e" exitCode=0
Oct 30 03:12:22.727238 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:22.727196    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj" event={"ID":"5a91b2a4-32ed-4d45-9887-deac61cb61f1","Type":"ContainerDied","Data":"99fd908530f86b8ca244869de8e9df06ce9ec2fe7f2b98723825a75a31b91f6e"}
Oct 30 03:12:23.735741 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.735710    4869 generic.go:356] "Generic (PLEG): container finished" podID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerID="ee164ca10ffde75b2c862b20ab1691c374463ce9f30bb31946731689498a506b" exitCode=0
Oct 30 03:12:23.736092 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.735793    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9" event={"ID":"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7","Type":"ContainerDied","Data":"ee164ca10ffde75b2c862b20ab1691c374463ce9f30bb31946731689498a506b"}
Oct 30 03:12:23.737774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.737753    4869 generic.go:356] "Generic (PLEG): container finished" podID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerID="97704e2cd0931f617cb8d208be0b98ccfb3b5e5f90a9d0c2b212773ad597f693" exitCode=0
Oct 30 03:12:23.737886 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.737818    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np" event={"ID":"3d630c78-9eea-488d-bb5d-e712dfb34f5f","Type":"ContainerDied","Data":"97704e2cd0931f617cb8d208be0b98ccfb3b5e5f90a9d0c2b212773ad597f693"}
Oct 30 03:12:23.739780 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.739761    4869 generic.go:356] "Generic (PLEG): container finished" podID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerID="bbae2105a5b642deb1f88493e1766138a85d01ea692485b976704de662801a8c" exitCode=0
Oct 30 03:12:23.739862 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.739837    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj" event={"ID":"5a91b2a4-32ed-4d45-9887-deac61cb61f1","Type":"ContainerDied","Data":"bbae2105a5b642deb1f88493e1766138a85d01ea692485b976704de662801a8c"}
Oct 30 03:12:23.741761 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.741743    4869 generic.go:356] "Generic (PLEG): container finished" podID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerID="0ce21bdf4d83a7e621ec82c2164c389ecde5288de45284d1530870671427bdc4" exitCode=0
Oct 30 03:12:23.741848 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:23.741785    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm" event={"ID":"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968","Type":"ContainerDied","Data":"0ce21bdf4d83a7e621ec82c2164c389ecde5288de45284d1530870671427bdc4"}
Oct 30 03:12:24.905709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.905684    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:24.947404 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.947383    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:24.951439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.951416    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:24.959260 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.956670    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\" (UniqueName: \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\") pod \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") "
Oct 30 03:12:24.959260 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.956798    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\") pod \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") "
Oct 30 03:12:24.959260 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.956849    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\") pod \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\" (UID: \"5a91b2a4-32ed-4d45-9887-deac61cb61f1\") "
Oct 30 03:12:24.959260 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.958059    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle" pod "5a91b2a4-32ed-4d45-9887-deac61cb61f1" (UID: "5a91b2a4-32ed-4d45-9887-deac61cb61f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:24.960883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.960824    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:24.961003 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.960981    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9" pod "5a91b2a4-32ed-4d45-9887-deac61cb61f1" (UID: "5a91b2a4-32ed-4d45-9887-deac61cb61f1"). InnerVolumeSpecName "kube-api-access-cknm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:24.964500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:24.964478    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util" pod "5a91b2a4-32ed-4d45-9887-deac61cb61f1" (UID: "5a91b2a4-32ed-4d45-9887-deac61cb61f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.057555 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057484    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\") pod \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") "
Oct 30 03:12:25.057555 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057516    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\" (UniqueName: \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\") pod \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057566    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\") pod \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057606    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\") pod \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057627    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\") pod \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057647    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\") pod \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057671    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\" (UniqueName: \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\") pod \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\" (UID: \"3d630c78-9eea-488d-bb5d-e712dfb34f5f\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057694    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\") pod \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\" (UID: \"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7\") "
Oct 30 03:12:25.057812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057726    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\" (UniqueName: \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\") pod \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\" (UID: \"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968\") "
Oct 30 03:12:25.058151 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057921    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.058151 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057935    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a91b2a4-32ed-4d45-9887-deac61cb61f1-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.058151 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.057950    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cknm9\" (UniqueName: \"kubernetes.io/projected/5a91b2a4-32ed-4d45-9887-deac61cb61f1-kube-api-access-cknm9\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.058370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.058340    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle" pod "3d630c78-9eea-488d-bb5d-e712dfb34f5f" (UID: "3d630c78-9eea-488d-bb5d-e712dfb34f5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.058707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.058664    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle" pod "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" (UID: "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.059368 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.059322    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle" pod "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" (UID: "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.060141 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.060105    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9" pod "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" (UID: "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7"). InnerVolumeSpecName "kube-api-access-xwzl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:25.060352 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.060335    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7" pod "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" (UID: "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968"). InnerVolumeSpecName "kube-api-access-522k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:25.060556 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.060541    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f" pod "3d630c78-9eea-488d-bb5d-e712dfb34f5f" (UID: "3d630c78-9eea-488d-bb5d-e712dfb34f5f"). InnerVolumeSpecName "kube-api-access-l984f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:25.064018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.063995    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util" pod "3d630c78-9eea-488d-bb5d-e712dfb34f5f" (UID: "3d630c78-9eea-488d-bb5d-e712dfb34f5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.066448 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.066423    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util" pod "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" (UID: "bb1cbcaf-ee16-4f2b-b0ef-bd775f089968"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.067051 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.067034    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util" pod "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" (UID: "a2a34ae3-8946-46f7-a6a1-1db9ffe132f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:25.158630 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158607    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158630 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158629    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwzl9\" (UniqueName: \"kubernetes.io/projected/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-kube-api-access-xwzl9\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158640    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158648    4869 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-bundle\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158656    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158664    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d630c78-9eea-488d-bb5d-e712dfb34f5f-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158672    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l984f\" (UniqueName: \"kubernetes.io/projected/3d630c78-9eea-488d-bb5d-e712dfb34f5f-kube-api-access-l984f\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158680    4869 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a34ae3-8946-46f7-a6a1-1db9ffe132f7-util\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.158736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.158689    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-522k7\" (UniqueName: \"kubernetes.io/projected/bb1cbcaf-ee16-4f2b-b0ef-bd775f089968-kube-api-access-522k7\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:25.754055 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.754034    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm"
Oct 30 03:12:25.754216 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.754074    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66szvm" event={"ID":"bb1cbcaf-ee16-4f2b-b0ef-bd775f089968","Type":"ContainerDied","Data":"db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8"}
Oct 30 03:12:25.754216 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.754154    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db6d39b5bc78e23b9f55a647736955577339fc919dd24bd6dd7bcd56417e28d8"
Oct 30 03:12:25.756069 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.756047    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9"
Oct 30 03:12:25.756184 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.756043    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abfpf9" event={"ID":"a2a34ae3-8946-46f7-a6a1-1db9ffe132f7","Type":"ContainerDied","Data":"1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9"}
Oct 30 03:12:25.756241 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.756196    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e20b05cdf70c3fa0b8e331ed5e9f1fa847cd18ec908fa76b4a40b88b60edca9"
Oct 30 03:12:25.758241 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.758216    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np" event={"ID":"3d630c78-9eea-488d-bb5d-e712dfb34f5f","Type":"ContainerDied","Data":"71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce"}
Oct 30 03:12:25.758365 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.758260    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71c972cca37def0e35278d2acef2a3518406b1a097cab513b1c4d253bc097bce"
Oct 30 03:12:25.758365 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.758225    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz56np"
Oct 30 03:12:25.760523 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.760501    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj" event={"ID":"5a91b2a4-32ed-4d45-9887-deac61cb61f1","Type":"ContainerDied","Data":"cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff"}
Oct 30 03:12:25.760652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.760535    4869 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc67e88f1af450c32ee25c24d0fe47ef3d35f05621e8c3d776856744cac10fff"
Oct 30 03:12:25.760652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:25.760546    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gqczj"
Oct 30 03:12:27.818822 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:12:27.818786    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:12:31.362846 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.362812    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"]
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363117    4869 cpu_manager.go:414] "containerMap: removing container" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363129    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363145    4869 cpu_manager.go:414] "containerMap: removing container" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363154    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363168    4869 cpu_manager.go:414] "containerMap: removing container" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363172    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363180    4869 cpu_manager.go:414] "containerMap: removing container" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363185    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363199    4869 cpu_manager.go:414] "containerMap: removing container" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363203    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363208    4869 cpu_manager.go:414] "containerMap: removing container" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363212    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363224    4869 cpu_manager.go:414] "containerMap: removing container" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363231    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363238    4869 cpu_manager.go:414] "containerMap: removing container" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363242    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363247    4869 cpu_manager.go:414] "containerMap: removing container" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363253    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363261    4869 cpu_manager.go:414] "containerMap: removing container" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363265    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="pull"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363271    4869 cpu_manager.go:414] "containerMap: removing container" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363276    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="util"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363283    4869 cpu_manager.go:414] "containerMap: removing container" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="extract"
Oct 30 03:12:31.363305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363287    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="extract"
Oct 30 03:12:31.364028 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363338    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d630c78-9eea-488d-bb5d-e712dfb34f5f" containerName="extract"
Oct 30 03:12:31.364028 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363348    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb1cbcaf-ee16-4f2b-b0ef-bd775f089968" containerName="extract"
Oct 30 03:12:31.364028 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363356    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a91b2a4-32ed-4d45-9887-deac61cb61f1" containerName="extract"
Oct 30 03:12:31.364028 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.363362    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2a34ae3-8946-46f7-a6a1-1db9ffe132f7" containerName="extract"
Oct 30 03:12:31.365894 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.365876    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:31.394939 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.394904    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 03:12:31.394939 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.394925    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 03:12:31.395137 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.394933    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pb2j6\""
Oct 30 03:12:31.396672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.396650    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"]
Oct 30 03:12:31.401267 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.401242    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qh95\" (UniqueName: \"kubernetes.io/projected/8479926b-9133-4823-b552-0f31a2db5282-kube-api-access-8qh95\") pod \"limitador-operator-controller-manager-69b7bb8c5c-vd7pn\" (UID: \"8479926b-9133-4823-b552-0f31a2db5282\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:31.501874 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.501842    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qh95\" (UniqueName: \"kubernetes.io/projected/8479926b-9133-4823-b552-0f31a2db5282-kube-api-access-8qh95\") pod \"limitador-operator-controller-manager-69b7bb8c5c-vd7pn\" (UID: \"8479926b-9133-4823-b552-0f31a2db5282\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:31.525444 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.525413    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qh95\" (UniqueName: \"kubernetes.io/projected/8479926b-9133-4823-b552-0f31a2db5282-kube-api-access-8qh95\") pod \"limitador-operator-controller-manager-69b7bb8c5c-vd7pn\" (UID: \"8479926b-9133-4823-b552-0f31a2db5282\") " pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:31.677294 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.677230    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:31.975791 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:31.975750    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"]
Oct 30 03:12:31.978123 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:31.978096    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8479926b_9133_4823_b552_0f31a2db5282.slice/crio-37c2320693800143525cab7401163909dd543c0d8dffaa6198d67017df87fdb4 WatchSource:0}: Error finding container 37c2320693800143525cab7401163909dd543c0d8dffaa6198d67017df87fdb4: Status 404 returned error can't find the container with id 37c2320693800143525cab7401163909dd543c0d8dffaa6198d67017df87fdb4
Oct 30 03:12:32.799793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:32.799755    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn" event={"ID":"8479926b-9133-4823-b552-0f31a2db5282","Type":"ContainerStarted","Data":"37c2320693800143525cab7401163909dd543c0d8dffaa6198d67017df87fdb4"}
Oct 30 03:12:34.819387 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:34.819353    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn" event={"ID":"8479926b-9133-4823-b552-0f31a2db5282","Type":"ContainerStarted","Data":"880ba51458a292b7bc244b5df36ffe70889c2a9799211d5cd580d18a959f30d7"}
Oct 30 03:12:34.819796 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:34.819424    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:34.859829 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:34.859774    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn" podStartSLOduration=1.5749087080000002 podStartE2EDuration="3.859759398s" totalImagesPullingTime="2.28485069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:34.859412777 +0000 UTC m=+1024.180992496" watchObservedRunningTime="2026-10-30 03:12:34.859759398 +0000 UTC m=+1024.181339118"
Oct 30 03:12:35.837771 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.837738    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"]
Oct 30 03:12:35.840211 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.840194    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:35.857878 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.857846    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vff2f\""
Oct 30 03:12:35.859956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.859934    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"]
Oct 30 03:12:35.935830 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.935807    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac689f53-d892-4d51-8976-84ce9966392f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:35.935939 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:35.935864    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgv67\" (UniqueName: \"kubernetes.io/projected/ac689f53-d892-4d51-8976-84ce9966392f-kube-api-access-fgv67\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.037244 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.037216    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac689f53-d892-4d51-8976-84ce9966392f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.037344 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.037280    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgv67\" (UniqueName: \"kubernetes.io/projected/ac689f53-d892-4d51-8976-84ce9966392f-kube-api-access-fgv67\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.037705 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.037688    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac689f53-d892-4d51-8976-84ce9966392f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.060749 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.060725    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgv67\" (UniqueName: \"kubernetes.io/projected/ac689f53-d892-4d51-8976-84ce9966392f-kube-api-access-fgv67\") pod \"kuadrant-operator-controller-manager-658c459c99-49k8w\" (UID: \"ac689f53-d892-4d51-8976-84ce9966392f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.152866 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.152819    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:36.488694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.488664    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"]
Oct 30 03:12:36.490456 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:36.490428    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac689f53_d892_4d51_8976_84ce9966392f.slice/crio-8c224fb523fc2b5f050609b10a6f565f690e704cbb5fa70d2e64ffe27cdd1e05 WatchSource:0}: Error finding container 8c224fb523fc2b5f050609b10a6f565f690e704cbb5fa70d2e64ffe27cdd1e05: Status 404 returned error can't find the container with id 8c224fb523fc2b5f050609b10a6f565f690e704cbb5fa70d2e64ffe27cdd1e05
Oct 30 03:12:36.832503 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:36.832432    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w" event={"ID":"ac689f53-d892-4d51-8976-84ce9966392f","Type":"ContainerStarted","Data":"8c224fb523fc2b5f050609b10a6f565f690e704cbb5fa70d2e64ffe27cdd1e05"}
Oct 30 03:12:40.512538 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.512506    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"]
Oct 30 03:12:40.518116 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.518094    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:40.552192 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.552160    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 30 03:12:40.552294 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.552245    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pndsh\""
Oct 30 03:12:40.554222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.554202    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"]
Oct 30 03:12:40.572369 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.572347    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm885\" (UniqueName: \"kubernetes.io/projected/12fa1ccf-4cb7-44a1-a375-ff6ea615da47-kube-api-access-gm885\") pod \"dns-operator-controller-manager-68df894cb4-2qg98\" (UID: \"12fa1ccf-4cb7-44a1-a375-ff6ea615da47\") " pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:40.672929 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.672902    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm885\" (UniqueName: \"kubernetes.io/projected/12fa1ccf-4cb7-44a1-a375-ff6ea615da47-kube-api-access-gm885\") pod \"dns-operator-controller-manager-68df894cb4-2qg98\" (UID: \"12fa1ccf-4cb7-44a1-a375-ff6ea615da47\") " pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:40.695792 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.695762    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm885\" (UniqueName: \"kubernetes.io/projected/12fa1ccf-4cb7-44a1-a375-ff6ea615da47-kube-api-access-gm885\") pod \"dns-operator-controller-manager-68df894cb4-2qg98\" (UID: \"12fa1ccf-4cb7-44a1-a375-ff6ea615da47\") " pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:40.833327 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:40.833261    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:41.128264 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:41.128242    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"]
Oct 30 03:12:41.130219 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:12:41.130190    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fa1ccf_4cb7_44a1_a375_ff6ea615da47.slice/crio-fd67061479cbbce175ec4de62b78d77b40b5c6f2286f3bd0157a7e39206a5972 WatchSource:0}: Error finding container fd67061479cbbce175ec4de62b78d77b40b5c6f2286f3bd0157a7e39206a5972: Status 404 returned error can't find the container with id fd67061479cbbce175ec4de62b78d77b40b5c6f2286f3bd0157a7e39206a5972
Oct 30 03:12:41.859842 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:41.859811    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98" event={"ID":"12fa1ccf-4cb7-44a1-a375-ff6ea615da47","Type":"ContainerStarted","Data":"fd67061479cbbce175ec4de62b78d77b40b5c6f2286f3bd0157a7e39206a5972"}
Oct 30 03:12:43.872697 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:43.872653    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98" event={"ID":"12fa1ccf-4cb7-44a1-a375-ff6ea615da47","Type":"ContainerStarted","Data":"ea45222e2ff47191083f9f660ee5b1a7eaf8d30f746b1d8cc230070b27a0640e"}
Oct 30 03:12:43.873123 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:43.872799    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:43.922593 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:43.922524    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98" podStartSLOduration=1.959423704 podStartE2EDuration="3.922507345s" totalImagesPullingTime="1.963083641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:43.921477408 +0000 UTC m=+1033.243057137" watchObservedRunningTime="2026-10-30 03:12:43.922507345 +0000 UTC m=+1033.244087067"
Oct 30 03:12:44.878521 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:44.878483    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w" event={"ID":"ac689f53-d892-4d51-8976-84ce9966392f","Type":"ContainerStarted","Data":"a7e96478bf54e2c7f6255db0e8c3960ee06a19918b86a9e0acf1a11f3ef08180"}
Oct 30 03:12:44.878942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:44.878574    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:44.948816 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:44.948767    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w" podStartSLOduration=2.220691356 podStartE2EDuration="9.94875541s" totalImagesPullingTime="7.728064054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:44.948455506 +0000 UTC m=+1034.270035225" watchObservedRunningTime="2026-10-30 03:12:44.94875541 +0000 UTC m=+1034.270335128"
Oct 30 03:12:45.826707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:45.826675    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-69b7bb8c5c-vd7pn"
Oct 30 03:12:54.881113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:54.881081    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-68df894cb4-2qg98"
Oct 30 03:12:55.886375 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:12:55.886343    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-658c459c99-49k8w"
Oct 30 03:12:57.819831 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:12:57.819797    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:13:27.677212 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.677176    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:27.679476 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.679458    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.697072 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.697049    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 03:13:27.705937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.705913    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-54rq2\""
Oct 30 03:13:27.710205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.710129    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:27.806201 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.806169    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:27.814730 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.814695    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56w2\" (UniqueName: \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.814871 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.814805    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.821166 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:13:27.821133    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:13:27.915409 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.915384    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56w2\" (UniqueName: \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.915551 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.915475    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.916081 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.916061    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.938134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.938107    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56w2\" (UniqueName: \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\") pod \"limitador-limitador-74dfcfb894-c9qvn\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:27.990520 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:27.990488    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:28.283899 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:28.283876    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:28.286172 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:13:28.286147    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5838abfe_2058_4c8a_9a93_012e6333be7b.slice/crio-9f6fcd6c722400f0b34d0681646f61a72f347707425d62a14bdf8da50f75ae59 WatchSource:0}: Error finding container 9f6fcd6c722400f0b34d0681646f61a72f347707425d62a14bdf8da50f75ae59: Status 404 returned error can't find the container with id 9f6fcd6c722400f0b34d0681646f61a72f347707425d62a14bdf8da50f75ae59
Oct 30 03:13:29.089511 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.089480    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" event={"ID":"5838abfe-2058-4c8a-9a93-012e6333be7b","Type":"ContainerStarted","Data":"9f6fcd6c722400f0b34d0681646f61a72f347707425d62a14bdf8da50f75ae59"}
Oct 30 03:13:29.256563 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.256527    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:29.259273 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.259250    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:29.278198 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.278166    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:29.286758 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.286737    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xksk4\""
Oct 30 03:13:29.326177 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.326150    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9r4\" (UniqueName: \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\") pod \"authorino-56c6c9ddd5-t7mfz\" (UID: \"fac08924-09dd-4216-9177-8008d3ef281f\") " pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:29.426754 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.426681    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9r4\" (UniqueName: \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\") pod \"authorino-56c6c9ddd5-t7mfz\" (UID: \"fac08924-09dd-4216-9177-8008d3ef281f\") " pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:29.449821 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.449799    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9r4\" (UniqueName: \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\") pod \"authorino-56c6c9ddd5-t7mfz\" (UID: \"fac08924-09dd-4216-9177-8008d3ef281f\") " pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:29.571924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.571903    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:29.864012 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:29.863860    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:29.866287 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:13:29.866254    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfac08924_09dd_4216_9177_8008d3ef281f.slice/crio-dce61337c98360276061389ccd391c896c949bdc5023d2298f9aca899920bc84 WatchSource:0}: Error finding container dce61337c98360276061389ccd391c896c949bdc5023d2298f9aca899920bc84: Status 404 returned error can't find the container with id dce61337c98360276061389ccd391c896c949bdc5023d2298f9aca899920bc84
Oct 30 03:13:30.096055 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:30.096023    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" event={"ID":"fac08924-09dd-4216-9177-8008d3ef281f","Type":"ContainerStarted","Data":"dce61337c98360276061389ccd391c896c949bdc5023d2298f9aca899920bc84"}
Oct 30 03:13:30.097564 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:30.097539    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" event={"ID":"5838abfe-2058-4c8a-9a93-012e6333be7b","Type":"ContainerStarted","Data":"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"}
Oct 30 03:13:30.097710 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:30.097695    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:30.138610 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:30.138521    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" podStartSLOduration=1.933947825 podStartE2EDuration="3.138510167s" totalImagesPullingTime="1.204562342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:30.13745916 +0000 UTC m=+1079.459038882" watchObservedRunningTime="2026-10-30 03:13:30.138510167 +0000 UTC m=+1079.460089885"
Oct 30 03:13:32.109482 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:32.109440    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" event={"ID":"fac08924-09dd-4216-9177-8008d3ef281f","Type":"ContainerStarted","Data":"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"}
Oct 30 03:13:32.147888 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:32.147842    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" podStartSLOduration=1.591156418 podStartE2EDuration="3.147827146s" totalImagesPullingTime="1.556670728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:32.147617579 +0000 UTC m=+1081.469197295" watchObservedRunningTime="2026-10-30 03:13:32.147827146 +0000 UTC m=+1081.469406865"
Oct 30 03:13:41.104646 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:41.104613    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:41.818506 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:41.818470    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:41.818737 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:41.818707    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" podUID="5838abfe-2058-4c8a-9a93-012e6333be7b" containerName="limitador" containerID="cri-o://038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3" gracePeriod=30
Oct 30 03:13:42.356442 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.356420    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:42.406901 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.406842    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\" (UniqueName: \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\") pod \"5838abfe-2058-4c8a-9a93-012e6333be7b\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") "
Oct 30 03:13:42.406901 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.406892    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\" (UniqueName: \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\") pod \"5838abfe-2058-4c8a-9a93-012e6333be7b\" (UID: \"5838abfe-2058-4c8a-9a93-012e6333be7b\") "
Oct 30 03:13:42.407178 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.407134    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file" pod "5838abfe-2058-4c8a-9a93-012e6333be7b" (UID: "5838abfe-2058-4c8a-9a93-012e6333be7b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:13:42.409042 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.409017    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2" pod "5838abfe-2058-4c8a-9a93-012e6333be7b" (UID: "5838abfe-2058-4c8a-9a93-012e6333be7b"). InnerVolumeSpecName "kube-api-access-g56w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:13:42.507736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.507714    4869 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5838abfe-2058-4c8a-9a93-012e6333be7b-config-file\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:42.507736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:42.507737    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56w2\" (UniqueName: \"kubernetes.io/projected/5838abfe-2058-4c8a-9a93-012e6333be7b-kube-api-access-g56w2\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:43.166130 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.166061    4869 generic.go:356] "Generic (PLEG): container finished" podID="5838abfe-2058-4c8a-9a93-012e6333be7b" containerID="038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3" exitCode=0
Oct 30 03:13:43.166130 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.166103    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"
Oct 30 03:13:43.166302 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.166140    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" event={"ID":"5838abfe-2058-4c8a-9a93-012e6333be7b","Type":"ContainerDied","Data":"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"}
Oct 30 03:13:43.166302 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.166194    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-c9qvn" event={"ID":"5838abfe-2058-4c8a-9a93-012e6333be7b","Type":"ContainerDied","Data":"9f6fcd6c722400f0b34d0681646f61a72f347707425d62a14bdf8da50f75ae59"}
Oct 30 03:13:43.166302 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.166220    4869 scope.go:122] "RemoveContainer" containerID="038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"
Oct 30 03:13:43.175011 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.174981    4869 scope.go:122] "RemoveContainer" containerID="038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"
Oct 30 03:13:43.175299 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:13:43.175279    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3\": container with ID starting with 038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3 not found: ID does not exist" containerID="038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"
Oct 30 03:13:43.175370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.175308    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3"} err="failed to get container status \"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3\": rpc error: code = NotFound desc = could not find container \"038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3\": container with ID starting with 038c7904d83751e7f4bf8efcae0ee8582bdf943c6f0a20dd7034692ba7b6e3c3 not found: ID does not exist"
Oct 30 03:13:43.215653 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.215626    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:43.227296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:43.227274    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-c9qvn"]
Oct 30 03:13:44.818360 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:44.818309    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5838abfe-2058-4c8a-9a93-012e6333be7b" path="/var/lib/kubelet/pods/5838abfe-2058-4c8a-9a93-012e6333be7b/volumes"
Oct 30 03:13:55.299519 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.299479    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:55.299941 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.299686    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" podUID="fac08924-09dd-4216-9177-8008d3ef281f" containerName="authorino" containerID="cri-o://87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130" gracePeriod=30
Oct 30 03:13:55.549813 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.549755    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:55.599394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.599370    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\" (UniqueName: \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\") pod \"fac08924-09dd-4216-9177-8008d3ef281f\" (UID: \"fac08924-09dd-4216-9177-8008d3ef281f\") "
Oct 30 03:13:55.601307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.601284    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4" pod "fac08924-09dd-4216-9177-8008d3ef281f" (UID: "fac08924-09dd-4216-9177-8008d3ef281f"). InnerVolumeSpecName "kube-api-access-gt9r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:13:55.700395 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:55.700371    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt9r4\" (UniqueName: \"kubernetes.io/projected/fac08924-09dd-4216-9177-8008d3ef281f-kube-api-access-gt9r4\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:56.236248 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.236218    4869 generic.go:356] "Generic (PLEG): container finished" podID="fac08924-09dd-4216-9177-8008d3ef281f" containerID="87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130" exitCode=0
Oct 30 03:13:56.236394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.236257    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz"
Oct 30 03:13:56.236394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.236263    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" event={"ID":"fac08924-09dd-4216-9177-8008d3ef281f","Type":"ContainerDied","Data":"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"}
Oct 30 03:13:56.236524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.236401    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-t7mfz" event={"ID":"fac08924-09dd-4216-9177-8008d3ef281f","Type":"ContainerDied","Data":"dce61337c98360276061389ccd391c896c949bdc5023d2298f9aca899920bc84"}
Oct 30 03:13:56.236524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.236437    4869 scope.go:122] "RemoveContainer" containerID="87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"
Oct 30 03:13:56.245511 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.245494    4869 scope.go:122] "RemoveContainer" containerID="87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"
Oct 30 03:13:56.245812 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:13:56.245794    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130\": container with ID starting with 87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130 not found: ID does not exist" containerID="87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"
Oct 30 03:13:56.245866 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.245820    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130"} err="failed to get container status \"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130\": rpc error: code = NotFound desc = could not find container \"87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130\": container with ID starting with 87ab86e43a18ca8837fff73b7524bc351b7ce2718d0f29fd41c89ebf07e62130 not found: ID does not exist"
Oct 30 03:13:56.285347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.285324    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:56.296774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.296751    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-t7mfz"]
Oct 30 03:13:56.823647 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:13:56.823612    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fac08924-09dd-4216-9177-8008d3ef281f" path="/var/lib/kubelet/pods/fac08924-09dd-4216-9177-8008d3ef281f/volumes"
Oct 30 03:13:57.819365 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:13:57.819327    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:14:16.885711 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.885616    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"]
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.885945    4869 cpu_manager.go:414] "containerMap: removing container" podUID="fac08924-09dd-4216-9177-8008d3ef281f" containerName="authorino"
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.885957    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fac08924-09dd-4216-9177-8008d3ef281f" containerName="authorino"
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.885980    4869 cpu_manager.go:414] "containerMap: removing container" podUID="5838abfe-2058-4c8a-9a93-012e6333be7b" containerName="limitador"
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.885985    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5838abfe-2058-4c8a-9a93-012e6333be7b" containerName="limitador"
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.886043    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="fac08924-09dd-4216-9177-8008d3ef281f" containerName="authorino"
Oct 30 03:14:16.886182 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.886055    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="5838abfe-2058-4c8a-9a93-012e6333be7b" containerName="limitador"
Oct 30 03:14:16.891497 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.891476    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.918275 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.918251    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"]
Oct 30 03:14:16.952326 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952296    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952447 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952330    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c198945-756e-4bd5-9fee-ae06c5e590b9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952447 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952351    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952527 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952485    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952527 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952514    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952645 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952629    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtt6x\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-kube-api-access-gtt6x\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:16.952688 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:16.952656    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053684 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053653    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c198945-756e-4bd5-9fee-ae06c5e590b9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053815 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053696    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053859 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053841    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053894 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053873    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053940 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053925    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtt6x\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-kube-api-access-gtt6x\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.053974 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053958    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.054021 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.053987    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.054778 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.054748    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.056058 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.056033    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c198945-756e-4bd5-9fee-ae06c5e590b9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.056210 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.056195    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.056253 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.056218    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.056317 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.056301    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.076794 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.076769    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.077236 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.077219    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtt6x\" (UniqueName: \"kubernetes.io/projected/8c198945-756e-4bd5-9fee-ae06c5e590b9-kube-api-access-gtt6x\") pod \"istiod-openshift-gateway-7ddd9cfdc8-l7g8g\" (UID: \"8c198945-756e-4bd5-9fee-ae06c5e590b9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.203429 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.203407    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:17.520212 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.520181    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"]
Oct 30 03:14:17.521785 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:14:17.521759    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c198945_756e_4bd5_9fee_ae06c5e590b9.slice/crio-c2bc54fdc27cb633aa42b5fdd0c419efcc073c2a013d4af41d4878d2a3bfa8c1 WatchSource:0}: Error finding container c2bc54fdc27cb633aa42b5fdd0c419efcc073c2a013d4af41d4878d2a3bfa8c1: Status 404 returned error can't find the container with id c2bc54fdc27cb633aa42b5fdd0c419efcc073c2a013d4af41d4878d2a3bfa8c1
Oct 30 03:14:17.523777 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.523745    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:14:17.523857 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:17.523800    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:14:18.340709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.340678    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g" event={"ID":"8c198945-756e-4bd5-9fee-ae06c5e590b9","Type":"ContainerStarted","Data":"e12cb88e2d2f5255b4f95a4dc4d74f47c613a88a208d9cff886c6c174d125363"}
Oct 30 03:14:18.341166 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.340725    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g" event={"ID":"8c198945-756e-4bd5-9fee-ae06c5e590b9","Type":"ContainerStarted","Data":"c2bc54fdc27cb633aa42b5fdd0c419efcc073c2a013d4af41d4878d2a3bfa8c1"}
Oct 30 03:14:18.341166 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.340864    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:18.342233 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.342210    4869 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-l7g8g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 03:14:18.342363 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.342258    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g" podUID="8c198945-756e-4bd5-9fee-ae06c5e590b9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:14:18.433192 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:18.433152    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g" podStartSLOduration=2.433140471 podStartE2EDuration="2.433140471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:14:18.421475459 +0000 UTC m=+1127.743055180" watchObservedRunningTime="2026-10-30 03:14:18.433140471 +0000 UTC m=+1127.754720191"
Oct 30 03:14:19.346544 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.346517    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l7g8g"
Oct 30 03:14:19.440208 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.440174    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:14:19.440385 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.440365    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerName="discovery" containerID="cri-o://c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e" gracePeriod=30
Oct 30 03:14:19.671652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.671617    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:14:19.775872 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775830    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775883    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775925    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775945    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775966    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.775984    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776256 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.776070    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\") pod \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\" (UID: \"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0\") "
Oct 30 03:14:19.776410 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.776363    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:19.778290 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778260    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:19.778382 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778357    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:19.778560 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778531    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:14:19.778643 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778545    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:19.778756 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778737    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:14:19.778812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.778794    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl" pod "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" (UID: "9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0"). InnerVolumeSpecName "kube-api-access-n9shl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:14:19.877453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877402    4869 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-ca-configmap\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877427    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877436    4869 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-local-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877445    4869 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-cacerts\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877453    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9shl\" (UniqueName: \"kubernetes.io/projected/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-kube-api-access-n9shl\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877677 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877461    4869 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-kubeconfig\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:19.877677 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:19.877470    4869 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0-istio-csr-dns-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:14:20.353828 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.353798    4869 generic.go:356] "Generic (PLEG): container finished" podID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerID="c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e" exitCode=0
Oct 30 03:14:20.354180 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.353858    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"
Oct 30 03:14:20.354180 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.353887    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" event={"ID":"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0","Type":"ContainerDied","Data":"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"}
Oct 30 03:14:20.354180 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.353941    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs" event={"ID":"9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0","Type":"ContainerDied","Data":"be47ecd99cd21d53b1a3166a2df5f97af050dec90d57aaa025990445371fdbeb"}
Oct 30 03:14:20.354180 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.353971    4869 scope.go:122] "RemoveContainer" containerID="c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"
Oct 30 03:14:20.363548 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.363529    4869 scope.go:122] "RemoveContainer" containerID="c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"
Oct 30 03:14:20.363846 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:14:20.363824    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e\": container with ID starting with c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e not found: ID does not exist" containerID="c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"
Oct 30 03:14:20.363884 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.363856    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e"} err="failed to get container status \"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e\": rpc error: code = NotFound desc = could not find container \"c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e\": container with ID starting with c4cc1521e4f8bebcd3f7df963c05d2b9c2a5a09f1394e635ff582d569479918e not found: ID does not exist"
Oct 30 03:14:20.415880 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.415853    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:14:20.427534 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.427514    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-b25rs"]
Oct 30 03:14:20.818848 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:20.818824    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" path="/var/lib/kubelet/pods/9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0/volumes"
Oct 30 03:14:27.819432 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:14:27.819393    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:14:34.439995 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.439959    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:14:34.440361 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.440290    4869 cpu_manager.go:414] "containerMap: removing container" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerName="discovery"
Oct 30 03:14:34.440361 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.440301    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerName="discovery"
Oct 30 03:14:34.440428 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.440381    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="9692c49a-1dfb-4204-b07f-e4fbe0d6d6b0" containerName="discovery"
Oct 30 03:14:34.444881 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.444862    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.463306 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.463283    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Oct 30 03:14:34.464676 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.464652    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-kx49s\""
Oct 30 03:14:34.465213 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.465195    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:14:34.474777 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.474747    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 03:14:34.474865 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.474792    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 03:14:34.476416 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.476398    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-sqftd"]
Oct 30 03:14:34.479541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.479523    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.495818 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.495797    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-sqftd"]
Oct 30 03:14:34.516978 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.516956    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-45rtx"]
Oct 30 03:14:34.527112 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.527088    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.539110 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.539089    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-45rtx"]
Oct 30 03:14:34.563634 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.563606    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Oct 30 03:14:34.563810 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.563788    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-tk2jb\""
Oct 30 03:14:34.563810 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.563806    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Oct 30 03:14:34.563957 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.563845    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-w48r4\""
Oct 30 03:14:34.582030 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582005    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfl4h\" (UniqueName: \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.582113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582035    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.582113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582057    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02bdbc4-eb24-4846-8c78-a404d1d533f2-cert\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.582187 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582122    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j6wf\" (UniqueName: \"kubernetes.io/projected/5a6406de-58b5-4702-a3b8-59840bf510b4-kube-api-access-9j6wf\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.582224 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582184    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjnc\" (UniqueName: \"kubernetes.io/projected/c02bdbc4-eb24-4846-8c78-a404d1d533f2-kube-api-access-hcjnc\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.582254 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.582235    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a6406de-58b5-4702-a3b8-59840bf510b4-data\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.682972 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.682944    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfl4h\" (UniqueName: \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.683081 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.682979    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.683081 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.683008    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02bdbc4-eb24-4846-8c78-a404d1d533f2-cert\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.683193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.683117    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j6wf\" (UniqueName: \"kubernetes.io/projected/5a6406de-58b5-4702-a3b8-59840bf510b4-kube-api-access-9j6wf\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.683193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.683151    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjnc\" (UniqueName: \"kubernetes.io/projected/c02bdbc4-eb24-4846-8c78-a404d1d533f2-kube-api-access-hcjnc\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.683290 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.683212    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a6406de-58b5-4702-a3b8-59840bf510b4-data\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.683603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.683552    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a6406de-58b5-4702-a3b8-59840bf510b4-data\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.685499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.685471    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02bdbc4-eb24-4846-8c78-a404d1d533f2-cert\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.685609 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.685572    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.705199 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.705150    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j6wf\" (UniqueName: \"kubernetes.io/projected/5a6406de-58b5-4702-a3b8-59840bf510b4-kube-api-access-9j6wf\") pod \"seaweedfs-78bb9c6ff8-45rtx\" (UID: \"5a6406de-58b5-4702-a3b8-59840bf510b4\") " pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:34.705453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.705430    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfl4h\" (UniqueName: \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\") pod \"kserve-controller-manager-d55b668ff-tjrkv\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") " pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.705615 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.705600    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjnc\" (UniqueName: \"kubernetes.io/projected/c02bdbc4-eb24-4846-8c78-a404d1d533f2-kube-api-access-hcjnc\") pod \"llmisvc-controller-manager-59b8df5579-sqftd\" (UID: \"c02bdbc4-eb24-4846-8c78-a404d1d533f2\") " pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.756647 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.756622    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:34.793100 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.792923    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:34.838872 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:34.838841    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:35.057923 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.057900    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:14:35.059596 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:14:35.059554    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcce24d2_82ae_4ef1_96ec_ab416ae06b62.slice/crio-12563b35f2846737ba7c2e36f338a32fbef613b16888b4731d5701e950c24a6b WatchSource:0}: Error finding container 12563b35f2846737ba7c2e36f338a32fbef613b16888b4731d5701e950c24a6b: Status 404 returned error can't find the container with id 12563b35f2846737ba7c2e36f338a32fbef613b16888b4731d5701e950c24a6b
Oct 30 03:14:35.098622 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.098599    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-sqftd"]
Oct 30 03:14:35.100179 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:14:35.100142    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02bdbc4_eb24_4846_8c78_a404d1d533f2.slice/crio-60297ec9b52f95d32c90d3dff835a4cfdc8543997557d047676413ad814240f9 WatchSource:0}: Error finding container 60297ec9b52f95d32c90d3dff835a4cfdc8543997557d047676413ad814240f9: Status 404 returned error can't find the container with id 60297ec9b52f95d32c90d3dff835a4cfdc8543997557d047676413ad814240f9
Oct 30 03:14:35.145598 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.145558    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-45rtx"]
Oct 30 03:14:35.146606 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:14:35.146565    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6406de_58b5_4702_a3b8_59840bf510b4.slice/crio-22e6d516d9f6b3077b0043441dba9c2ec80160a7ff2ccff7598c06d8874ca323 WatchSource:0}: Error finding container 22e6d516d9f6b3077b0043441dba9c2ec80160a7ff2ccff7598c06d8874ca323: Status 404 returned error can't find the container with id 22e6d516d9f6b3077b0043441dba9c2ec80160a7ff2ccff7598c06d8874ca323
Oct 30 03:14:35.430169 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.430110    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-45rtx" event={"ID":"5a6406de-58b5-4702-a3b8-59840bf510b4","Type":"ContainerStarted","Data":"22e6d516d9f6b3077b0043441dba9c2ec80160a7ff2ccff7598c06d8874ca323"}
Oct 30 03:14:35.431314 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.431287    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd" event={"ID":"c02bdbc4-eb24-4846-8c78-a404d1d533f2","Type":"ContainerStarted","Data":"60297ec9b52f95d32c90d3dff835a4cfdc8543997557d047676413ad814240f9"}
Oct 30 03:14:35.432448 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:35.432418    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" event={"ID":"dcce24d2-82ae-4ef1-96ec-ab416ae06b62","Type":"ContainerStarted","Data":"12563b35f2846737ba7c2e36f338a32fbef613b16888b4731d5701e950c24a6b"}
Oct 30 03:14:39.460557 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.460520    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" event={"ID":"dcce24d2-82ae-4ef1-96ec-ab416ae06b62","Type":"ContainerStarted","Data":"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"}
Oct 30 03:14:39.460983 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.460689    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:14:39.462153 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.462131    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-45rtx" event={"ID":"5a6406de-58b5-4702-a3b8-59840bf510b4","Type":"ContainerStarted","Data":"03746652ad2447f7db15c07678edf5bdea99b6f0dd694e236ed29f6559ca3e4e"}
Oct 30 03:14:39.462273 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.462177    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:39.463718 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.463694    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd" event={"ID":"c02bdbc4-eb24-4846-8c78-a404d1d533f2","Type":"ContainerStarted","Data":"c7e18463fbf9983a32aeae722564455511af93d8fa13ad1a9b52ffb4b6044c6a"}
Oct 30 03:14:39.463828 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.463817    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:14:39.504281 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.504235    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" podStartSLOduration=1.9361608110000001 podStartE2EDuration="5.504219127s" totalImagesPullingTime="3.568058316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:14:39.501497832 +0000 UTC m=+1148.823077551" watchObservedRunningTime="2026-10-30 03:14:39.504219127 +0000 UTC m=+1148.825798847"
Oct 30 03:14:39.542101 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.542060    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd" podStartSLOduration=1.971353269 podStartE2EDuration="5.542048627s" totalImagesPullingTime="3.570695358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:14:39.540709249 +0000 UTC m=+1148.862288969" watchObservedRunningTime="2026-10-30 03:14:39.542048627 +0000 UTC m=+1148.863628345"
Oct 30 03:14:39.579784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:39.579692    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-45rtx" podStartSLOduration=1.392926131 podStartE2EDuration="5.579674437s" totalImagesPullingTime="4.186748306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:14:39.579301628 +0000 UTC m=+1148.900881348" watchObservedRunningTime="2026-10-30 03:14:39.579674437 +0000 UTC m=+1148.901254158"
Oct 30 03:14:45.471541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:14:45.471507    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-45rtx"
Oct 30 03:14:57.820534 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:14:57.820499    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:15:10.471177 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:10.471142    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-59b8df5579-sqftd"
Oct 30 03:15:10.474020 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:10.473995    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:15:23.334856 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.334820    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:15:23.335308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.335042    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" podUID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" containerName="manager" containerID="cri-o://d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106" gracePeriod=10
Oct 30 03:15:23.363008 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.362982    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-2gxqk"]
Oct 30 03:15:23.365235 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.365215    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.381044 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.381021    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-2gxqk"]
Oct 30 03:15:23.442832 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.442808    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv69r\" (UniqueName: \"kubernetes.io/projected/2990e125-0c96-4497-9c19-83f7c89cab1e-kube-api-access-qv69r\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.442953 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.442838    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2990e125-0c96-4497-9c19-83f7c89cab1e-cert\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.543883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.543850    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv69r\" (UniqueName: \"kubernetes.io/projected/2990e125-0c96-4497-9c19-83f7c89cab1e-kube-api-access-qv69r\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.544050 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.543889    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2990e125-0c96-4497-9c19-83f7c89cab1e-cert\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.546089 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.546065    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2990e125-0c96-4497-9c19-83f7c89cab1e-cert\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.566357 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.566334    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv69r\" (UniqueName: \"kubernetes.io/projected/2990e125-0c96-4497-9c19-83f7c89cab1e-kube-api-access-qv69r\") pod \"kserve-controller-manager-d55b668ff-2gxqk\" (UID: \"2990e125-0c96-4497-9c19-83f7c89cab1e\") " pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.586447 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.586396    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:15:23.644321 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.644294    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\" (UniqueName: \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\") pod \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") "
Oct 30 03:15:23.644450 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.644347    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\" (UniqueName: \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\") pod \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\" (UID: \"dcce24d2-82ae-4ef1-96ec-ab416ae06b62\") "
Oct 30 03:15:23.646431 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.646404    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert" pod "dcce24d2-82ae-4ef1-96ec-ab416ae06b62" (UID: "dcce24d2-82ae-4ef1-96ec-ab416ae06b62"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:23.646905 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.646877    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h" pod "dcce24d2-82ae-4ef1-96ec-ab416ae06b62" (UID: "dcce24d2-82ae-4ef1-96ec-ab416ae06b62"). InnerVolumeSpecName "kube-api-access-dfl4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:23.687748 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.687713    4869 generic.go:356] "Generic (PLEG): container finished" podID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" containerID="d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106" exitCode=0
Oct 30 03:15:23.687855 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.687759    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" event={"ID":"dcce24d2-82ae-4ef1-96ec-ab416ae06b62","Type":"ContainerDied","Data":"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"}
Oct 30 03:15:23.687855 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.687785    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv"
Oct 30 03:15:23.687855 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.687801    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-tjrkv" event={"ID":"dcce24d2-82ae-4ef1-96ec-ab416ae06b62","Type":"ContainerDied","Data":"12563b35f2846737ba7c2e36f338a32fbef613b16888b4731d5701e950c24a6b"}
Oct 30 03:15:23.687855 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.687824    4869 scope.go:122] "RemoveContainer" containerID="d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"
Oct 30 03:15:23.695945 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.695924    4869 scope.go:122] "RemoveContainer" containerID="d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"
Oct 30 03:15:23.696229 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:15:23.696203    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106\": container with ID starting with d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106 not found: ID does not exist" containerID="d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"
Oct 30 03:15:23.696321 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.696237    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106"} err="failed to get container status \"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106\": rpc error: code = NotFound desc = could not find container \"d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106\": container with ID starting with d39f86e13b240d2b64be8b80c2434316b59f755e420c07dd54a02078ef4f5106 not found: ID does not exist"
Oct 30 03:15:23.712008 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.711990    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:23.741021 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.740988    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:15:23.747498 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.747472    4869 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:23.747681 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.747664    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfl4h\" (UniqueName: \"kubernetes.io/projected/dcce24d2-82ae-4ef1-96ec-ab416ae06b62-kube-api-access-dfl4h\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:23.748881 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:23.748856    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-tjrkv"]
Oct 30 03:15:24.011749 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.011720    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55b668ff-2gxqk"]
Oct 30 03:15:24.013660 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:15:24.013633    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2990e125_0c96_4497_9c19_83f7c89cab1e.slice/crio-a86fc567bb44dd60c37ba9b0ba01e34cb8b02baa780310f1584e87bec6e993ae WatchSource:0}: Error finding container a86fc567bb44dd60c37ba9b0ba01e34cb8b02baa780310f1584e87bec6e993ae: Status 404 returned error can't find the container with id a86fc567bb44dd60c37ba9b0ba01e34cb8b02baa780310f1584e87bec6e993ae
Oct 30 03:15:24.014960 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.014941    4869 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:15:24.694565 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.694533    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk" event={"ID":"2990e125-0c96-4497-9c19-83f7c89cab1e","Type":"ContainerStarted","Data":"fe8d39485e83ba5830e6bfc307c29e09608b6ce582fd360183884dc1011a25a0"}
Oct 30 03:15:24.695021 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.694601    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk" event={"ID":"2990e125-0c96-4497-9c19-83f7c89cab1e","Type":"ContainerStarted","Data":"a86fc567bb44dd60c37ba9b0ba01e34cb8b02baa780310f1584e87bec6e993ae"}
Oct 30 03:15:24.695021 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.694632    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:24.735361 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.735303    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk" podStartSLOduration=1.385165122 podStartE2EDuration="1.735291222s" totalImagesPullingTime="350.1261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:24.733951725 +0000 UTC m=+1194.055531447" watchObservedRunningTime="2026-10-30 03:15:24.735291222 +0000 UTC m=+1194.056870969"
Oct 30 03:15:24.819186 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:24.819156    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" path="/var/lib/kubelet/pods/dcce24d2-82ae-4ef1-96ec-ab416ae06b62/volumes"
Oct 30 03:15:27.819677 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:15:27.819639    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:15:30.924112 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:30.924084    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:15:30.928845 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:30.928821    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:15:55.705396 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:55.705365    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-d55b668ff-2gxqk"
Oct 30 03:15:57.820152 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:15:57.820113    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:15:57.880930 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.880893    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-56ddc4c448-dvk96"]
Oct 30 03:15:57.881324 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.881305    4869 cpu_manager.go:414] "containerMap: removing container" podUID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" containerName="manager"
Oct 30 03:15:57.881416 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.881326    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" containerName="manager"
Oct 30 03:15:57.881475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.881431    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="dcce24d2-82ae-4ef1-96ec-ab416ae06b62" containerName="manager"
Oct 30 03:15:57.884663 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.884640    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:57.914454 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.914432    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-xmcj9\""
Oct 30 03:15:57.914649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.914469    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Oct 30 03:15:57.916433 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.916413    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-dvk96"]
Oct 30 03:15:57.942310 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.942287    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-5kvsh"]
Oct 30 03:15:57.945639 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.945623    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:57.979735 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.979717    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-5kvsh"]
Oct 30 03:15:57.980500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.980482    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-cert\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:57.980569 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.980513    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9htgt\" (UniqueName: \"kubernetes.io/projected/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-kube-api-access-9htgt\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:57.980569 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.980530    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:57.980569 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.980548    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cnp\" (UniqueName: \"kubernetes.io/projected/19416b1b-a9c1-4f72-a1de-b414893b749f-kube-api-access-44cnp\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:57.980741 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:57.980721    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19416b1b-a9c1-4f72-a1de-b414893b749f-tls-certs\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.011251 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.011225    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Oct 30 03:15:58.011415 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.011384    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Oct 30 03:15:58.011485 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.011471    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-m7msh\""
Oct 30 03:15:58.081486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.081433    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-cert\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.081486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.081465    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9htgt\" (UniqueName: \"kubernetes.io/projected/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-kube-api-access-9htgt\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.081640 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.081488    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.081640 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.081610    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cnp\" (UniqueName: \"kubernetes.io/projected/19416b1b-a9c1-4f72-a1de-b414893b749f-kube-api-access-44cnp\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.081718 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.081648    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19416b1b-a9c1-4f72-a1de-b414893b749f-tls-certs\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.084001 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.083983    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-cert\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.084144 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.084125    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.084193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.084125    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19416b1b-a9c1-4f72-a1de-b414893b749f-tls-certs\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.107726 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.107698    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cnp\" (UniqueName: \"kubernetes.io/projected/19416b1b-a9c1-4f72-a1de-b414893b749f-kube-api-access-44cnp\") pod \"model-serving-api-56ddc4c448-dvk96\" (UID: \"19416b1b-a9c1-4f72-a1de-b414893b749f\") " pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.107940 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.107922    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9htgt\" (UniqueName: \"kubernetes.io/projected/90165ca1-00dd-41f8-88bc-2b6d9bf5e95d-kube-api-access-9htgt\") pod \"odh-model-controller-7f9f8cdc65-5kvsh\" (UID: \"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d\") " pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.197630 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.197603    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:15:58.258112 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.258072    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:15:58.509007 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.508984    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-dvk96"]
Oct 30 03:15:58.510454 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:15:58.510425    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19416b1b_a9c1_4f72_a1de_b414893b749f.slice/crio-2d0b80e48338a6bd71aaeed7b62793d04cdd4dd5216e1285ba87da5e36db7b46 WatchSource:0}: Error finding container 2d0b80e48338a6bd71aaeed7b62793d04cdd4dd5216e1285ba87da5e36db7b46: Status 404 returned error can't find the container with id 2d0b80e48338a6bd71aaeed7b62793d04cdd4dd5216e1285ba87da5e36db7b46
Oct 30 03:15:58.562655 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.562629    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-5kvsh"]
Oct 30 03:15:58.563201 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:15:58.563176    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90165ca1_00dd_41f8_88bc_2b6d9bf5e95d.slice/crio-41558fda8636d40e9e52014b6c9126e743c436168f2b6e85715c53642500bda9 WatchSource:0}: Error finding container 41558fda8636d40e9e52014b6c9126e743c436168f2b6e85715c53642500bda9: Status 404 returned error can't find the container with id 41558fda8636d40e9e52014b6c9126e743c436168f2b6e85715c53642500bda9
Oct 30 03:15:58.867994 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.867915    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh" event={"ID":"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d","Type":"ContainerStarted","Data":"41558fda8636d40e9e52014b6c9126e743c436168f2b6e85715c53642500bda9"}
Oct 30 03:15:58.869095 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:15:58.869072    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-dvk96" event={"ID":"19416b1b-a9c1-4f72-a1de-b414893b749f","Type":"ContainerStarted","Data":"2d0b80e48338a6bd71aaeed7b62793d04cdd4dd5216e1285ba87da5e36db7b46"}
Oct 30 03:16:00.885189 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:00.885153    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-dvk96" event={"ID":"19416b1b-a9c1-4f72-a1de-b414893b749f","Type":"ContainerStarted","Data":"c0768c9127c02297b48d71573e3879753c6e8a10bb4eeacf52a67ea0f733b33d"}
Oct 30 03:16:00.885621 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:00.885272    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:16:00.925201 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:00.925145    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/model-serving-api-56ddc4c448-dvk96" podStartSLOduration=2.295705942 podStartE2EDuration="3.925127221s" totalImagesPullingTime="1.629421279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:00.924910007 +0000 UTC m=+1230.246489732" watchObservedRunningTime="2026-10-30 03:16:00.925127221 +0000 UTC m=+1230.246706942"
Oct 30 03:16:01.892417 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:01.892376    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh" event={"ID":"90165ca1-00dd-41f8-88bc-2b6d9bf5e95d","Type":"ContainerStarted","Data":"21aee0f21ad63391247e4793351e353a814563b73713251237e8617dba9b44e8"}
Oct 30 03:16:01.892937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:01.892567    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:16:01.939541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:01.939487    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh" podStartSLOduration=2.348350881 podStartE2EDuration="4.939475352s" totalImagesPullingTime="2.591124471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:01.938596181 +0000 UTC m=+1231.260175891" watchObservedRunningTime="2026-10-30 03:16:01.939475352 +0000 UTC m=+1231.261055071"
Oct 30 03:16:11.897569 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:11.897539    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-56ddc4c448-dvk96"
Oct 30 03:16:12.898898 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:16:12.898870    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7f9f8cdc65-5kvsh"
Oct 30 03:16:27.819611 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:16:27.819558    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:16:57.819630 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:16:57.819596    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:17:27.819464 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:17:27.819431    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:17:57.819680 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:17:57.819639    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:18:14.444815 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.444782    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:18:14.448324 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.448299    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.456439 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:18:14.456412    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdb6d2e_5233_4365_87e1_9129a7253a6e.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 03:18:14.475720 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.475694    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"kube-root-ca.crt\""
Oct 30 03:18:14.475843 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.475709    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"openshift-service-ca.crt\""
Oct 30 03:18:14.475906 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.475845    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"default-dockercfg-n7dfh\""
Oct 30 03:18:14.476130 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.476111    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-epp-sa-dockercfg-x4mbx\""
Oct 30 03:18:14.476192 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.476175    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Oct 30 03:18:14.490938 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.490918    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:18:14.582863 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.582837    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.582975 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.582877    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwvkx\" (UniqueName: \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.684080 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.684040    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.684221 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.684112    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvkx\" (UniqueName: \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.686690 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.686663    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.709243 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.709181    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvkx\" (UniqueName: \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:14.762955 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:14.762929    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:15.068373 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:15.068347    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:18:15.070142 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:18:15.070110    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdb6d2e_5233_4365_87e1_9129a7253a6e.slice/crio-296c42781bfd0d95e1b8e668b449c7369cfd0914a558ab99ef14d5141c854159 WatchSource:0}: Error finding container 296c42781bfd0d95e1b8e668b449c7369cfd0914a558ab99ef14d5141c854159: Status 404 returned error can't find the container with id 296c42781bfd0d95e1b8e668b449c7369cfd0914a558ab99ef14d5141c854159
Oct 30 03:18:15.552763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:15.552727    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" event={"ID":"7cdb6d2e-5233-4365-87e1-9129a7253a6e","Type":"ContainerStarted","Data":"296c42781bfd0d95e1b8e668b449c7369cfd0914a558ab99ef14d5141c854159"}
Oct 30 03:18:17.566920 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:17.566880    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" event={"ID":"7cdb6d2e-5233-4365-87e1-9129a7253a6e","Type":"ContainerStarted","Data":"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"}
Oct 30 03:18:17.567289 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:17.567030    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:17.617223 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:17.617176    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podStartSLOduration=1.9441223380000001 podStartE2EDuration="3.617163179s" totalImagesPullingTime="1.673040841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:18:17.616517117 +0000 UTC m=+1366.938096832" watchObservedRunningTime="2026-10-30 03:18:17.617163179 +0000 UTC m=+1366.938742921"
Oct 30 03:18:27.821550 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:18:27.821513    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:18:48.573541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:48.573461    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:18:50.017329 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.017294    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:18:50.020611 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.020589    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.035965 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.035944    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"kube-root-ca.crt\""
Oct 30 03:18:50.048849 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.048820    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.048971 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.048944    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxvf\" (UniqueName: \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.050982 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.050960    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"test-cpu-accelerator-preset-ser-afc820a4-epp-sa-dockercfg-hnspn\""
Oct 30 03:18:50.051349 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.051326    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"openshift-service-ca.crt\""
Oct 30 03:18:50.051453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.051391    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"default-dockercfg-7wlnm\""
Oct 30 03:18:50.051605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.051556    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:18:50.059658 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.059636    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c\"/\"test-cb25a14c9ba423627edeb5388343bd353-kserve-self-signed-certs\""
Oct 30 03:18:50.149376 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.149343    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.149507 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.149403    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxvf\" (UniqueName: \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.151954 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.151926    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.172459 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.172435    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxvf\" (UniqueName: \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\") pod \"test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") " pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.336560 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.336489    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:50.676936 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.676908    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:18:50.678682 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:18:50.678651    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcdb821_a85c_49af_ad27_1a41c99b0326.slice/crio-706810026de88f9a94e655ceb6690c0dfcb3b8a2069aa13b9db39b5d3c56122c WatchSource:0}: Error finding container 706810026de88f9a94e655ceb6690c0dfcb3b8a2069aa13b9db39b5d3c56122c: Status 404 returned error can't find the container with id 706810026de88f9a94e655ceb6690c0dfcb3b8a2069aa13b9db39b5d3c56122c
Oct 30 03:18:50.737842 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:50.737805    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" event={"ID":"bfcdb821-a85c-49af-ad27-1a41c99b0326","Type":"ContainerStarted","Data":"706810026de88f9a94e655ceb6690c0dfcb3b8a2069aa13b9db39b5d3c56122c"}
Oct 30 03:18:51.682223 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:51.682188    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:18:51.745556 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:51.745521    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" event={"ID":"bfcdb821-a85c-49af-ad27-1a41c99b0326","Type":"ContainerStarted","Data":"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"}
Oct 30 03:18:51.745760 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:51.745611    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:18:51.798148 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:51.798024    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podStartSLOduration=2.798006919 podStartE2EDuration="2.798006919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:18:51.797223792 +0000 UTC m=+1401.118803511" watchObservedRunningTime="2026-10-30 03:18:51.798006919 +0000 UTC m=+1401.119586635"
Oct 30 03:18:57.819438 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:18:57.819406    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:18:58.573312 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.573273    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:18:58.676565 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.676533    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:18:58.680211 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.680190    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.703482 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.703458    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:18:58.715267 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715245    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715382 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715275    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715382 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715302    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715496 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715457    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715572 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715537    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715643 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715626    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhrd\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715730 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715680    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715738    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.715817 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.715771    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.782509 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.782490    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-pzw79\""
Oct 30 03:18:58.816149 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816125    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816268 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816171    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816331 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816292    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816390 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816331    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816447    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816536 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816511    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816612 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816549    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816612 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816595    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816609    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816635    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816625    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhrd\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816670    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.816973 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.816951    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.817193 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.817158    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.818748 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.818730    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.818999 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.818982    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.839295 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.839239    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhrd\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.839295 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.839253    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:58.993597 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:58.993554    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:18:59.309879 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:59.309851    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:18:59.310932 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:18:59.310906    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2ffb4a_3998_467a_ade4_9a646c270553.slice/crio-79f6b5192d34335a494299738cd1841208a3fe3560e69167d18ec890f07ff88f WatchSource:0}: Error finding container 79f6b5192d34335a494299738cd1841208a3fe3560e69167d18ec890f07ff88f: Status 404 returned error can't find the container with id 79f6b5192d34335a494299738cd1841208a3fe3560e69167d18ec890f07ff88f
Oct 30 03:18:59.796340 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:18:59.796302    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" event={"ID":"4c2ffb4a-3998-467a-ade4-9a646c270553","Type":"ContainerStarted","Data":"79f6b5192d34335a494299738cd1841208a3fe3560e69167d18ec890f07ff88f"}
Oct 30 03:19:02.285735 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.285706    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:02.286000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.285772    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:02.286000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.285801    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:02.819132 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.819091    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" event={"ID":"4c2ffb4a-3998-467a-ade4-9a646c270553","Type":"ContainerStarted","Data":"b0741278fa5fc9b587f1ec014a17160649c1d4a45e3a43e0cdef00267856183a"}
Oct 30 03:19:02.890297 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.890227    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podStartSLOduration=1.918128557 podStartE2EDuration="4.890207402s" totalImagesPullingTime="2.972078845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:19:02.887086411 +0000 UTC m=+1412.208666166" watchObservedRunningTime="2026-10-30 03:19:02.890207402 +0000 UTC m=+1412.211787122"
Oct 30 03:19:02.994059 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:02.994016    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:19:03.995305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:03.995270    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 03:19:03.995725 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:03.995318    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 03:19:04.994066 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:04.994030    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 03:19:04.994249 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:04.994081    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 03:19:05.994240 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:05.994200    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 03:19:05.994652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:05.994269    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 03:19:06.704208 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:06.704166    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main" containerID="cri-o://fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1" gracePeriod=45
Oct 30 03:19:06.994204 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:06.994121    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 03:19:06.994204 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:06.994176    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 03:19:07.994059 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:07.994027    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 03:19:07.994236 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:07.994090    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 03:19:08.573533 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:08.573494    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:19:08.998034 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:08.998003    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:19:08.998287 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:08.998264    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:19:08.998914 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:08.998893    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:19:13.731690 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.731650    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"]
Oct 30 03:19:13.735524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.735504    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.759227 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.759204    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"]
Oct 30 03:19:13.861469 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861444    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76ada6b-6390-464d-80cf-d3634469236b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861620 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861484    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861678 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861634    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861678 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861669    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861765    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861821 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861792    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76ada6b-6390-464d-80cf-d3634469236b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861821 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861808    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bl52\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-kube-api-access-7bl52\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861894 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861875    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.861963 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.861944    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.962809 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.962779    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76ada6b-6390-464d-80cf-d3634469236b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.962809 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.962811    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963020 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.962844    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963020 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.962952    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963020 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963001    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963191 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963025    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76ada6b-6390-464d-80cf-d3634469236b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963191 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963159    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bl52\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-kube-api-access-7bl52\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963185    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963209    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963276    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963344    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963545    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963688 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963671    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.963743 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.963678    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e76ada6b-6390-464d-80cf-d3634469236b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.965085 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.965066    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e76ada6b-6390-464d-80cf-d3634469236b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.965401 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.965384    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e76ada6b-6390-464d-80cf-d3634469236b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.986109 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.986053    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:13.986227 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:13.986208    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bl52\" (UniqueName: \"kubernetes.io/projected/e76ada6b-6390-464d-80cf-d3634469236b-kube-api-access-7bl52\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k\" (UID: \"e76ada6b-6390-464d-80cf-d3634469236b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:14.048831 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.048808    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:14.364318 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.364293    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"]
Oct 30 03:19:14.365746 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:19:14.365716    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76ada6b_6390_464d_80cf_d3634469236b.slice/crio-82dd35ef45c8c1ebc1a8b1d78723dc3ca577c7986ed516775c4f70eafb9ad568 WatchSource:0}: Error finding container 82dd35ef45c8c1ebc1a8b1d78723dc3ca577c7986ed516775c4f70eafb9ad568: Status 404 returned error can't find the container with id 82dd35ef45c8c1ebc1a8b1d78723dc3ca577c7986ed516775c4f70eafb9ad568
Oct 30 03:19:14.368785 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.368752    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:14.368875 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.368813    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:14.368875 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.368840    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:14.894752 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.894716    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" event={"ID":"e76ada6b-6390-464d-80cf-d3634469236b","Type":"ContainerStarted","Data":"41b5e7620adecdaaa04f359c3d7322fa9258e93697c73a789ac111a63012b560"}
Oct 30 03:19:14.895263 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.894780    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" event={"ID":"e76ada6b-6390-464d-80cf-d3634469236b","Type":"ContainerStarted","Data":"82dd35ef45c8c1ebc1a8b1d78723dc3ca577c7986ed516775c4f70eafb9ad568"}
Oct 30 03:19:14.953069 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:14.953025    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podStartSLOduration=1.953011634 podStartE2EDuration="1.953011634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:19:14.951453247 +0000 UTC m=+1424.273032967" watchObservedRunningTime="2026-10-30 03:19:14.953011634 +0000 UTC m=+1424.274591352"
Oct 30 03:19:15.049123 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:15.049085    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:15.050739 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:15.050716    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:15.050850 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:15.050762    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:16.049390 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:16.049358    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:16.049797 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:16.049406    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:17.049372 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:17.049335    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:17.049547 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:17.049389    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:18.049512 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:18.049474    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:18.049753 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:18.049530    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:18.588704 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:18.588664    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:19:18.589041 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:18.589018    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:19:19.049436 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:19.049401    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:19.049641 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:19.049454    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:20.050032 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:20.050001    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 03:19:20.050513 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:20.050053    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k" podUID="e76ada6b-6390-464d-80cf-d3634469236b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 03:19:21.053678 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:21.053649    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:21.054163 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:21.053943    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:21.054649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:21.054630    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k"
Oct 30 03:19:22.752841 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:22.752809    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:19:27.819596 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:19:27.819531    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:19:28.573644 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.573603    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:19:28.759881 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.759844    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:19:28.763421 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.763399    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.792094 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.792069    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:19:28.906049 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.905962    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906049 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906026    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906414 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906151    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906414 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906282    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906414 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906340    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906510 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906462    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906568 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906544    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906633    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htx4j\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:28.906684 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:28.906666    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007355 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007329    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007364    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007398    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htx4j\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007433    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007483    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007513    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007537    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007568    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007803 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007620    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.007928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007900    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.008009 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.007959    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.008091 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.008064    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.008386 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.008361    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.008494 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.008477    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.009762 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.009741    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.009896 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.009878    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.030387 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.030363    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.030732 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.030711    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htx4j\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-464gn\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.077430 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.077404    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:29.391733 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.391708    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:19:29.393028 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:19:29.393002    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55647964_88d3_4b0a_bcde_459b13687e66.slice/crio-51823deffc3cedcb5adc7baf2db82580692052c3a17902e778a6989c06473a96 WatchSource:0}: Error finding container 51823deffc3cedcb5adc7baf2db82580692052c3a17902e778a6989c06473a96: Status 404 returned error can't find the container with id 51823deffc3cedcb5adc7baf2db82580692052c3a17902e778a6989c06473a96
Oct 30 03:19:29.396015 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.395983    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:29.396129 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.396061    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:29.396129 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.396104    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:19:29.998760 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.998718    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" event={"ID":"55647964-88d3-4b0a-bcde-459b13687e66","Type":"ContainerStarted","Data":"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"}
Oct 30 03:19:29.999253 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:29.998789    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" event={"ID":"55647964-88d3-4b0a-bcde-459b13687e66","Type":"ContainerStarted","Data":"51823deffc3cedcb5adc7baf2db82580692052c3a17902e778a6989c06473a96"}
Oct 30 03:19:30.081601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:30.078645    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:30.081601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:30.079821    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:30.081601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:30.079872    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:31.087766 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:31.087729    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:31.088318 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:31.088286    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:32.091602 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:32.087971    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:32.091602 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:32.088029    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:33.078356 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:33.077925    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:33.078356 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:33.077986    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:34.084980 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:34.084940    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:34.085565 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:34.085529    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:35.092867 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:35.092831    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 03:19:35.093254 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:35.092887    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 03:19:36.081519 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.081485    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:36.081784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.081757    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:36.082446 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.082426    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:19:36.128192 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.128146    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podStartSLOduration=8.12813183 podStartE2EDuration="8.12813183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:19:30.058567514 +0000 UTC m=+1439.380147233" watchObservedRunningTime="2026-10-30 03:19:36.12813183 +0000 UTC m=+1445.449711549"
Oct 30 03:19:36.951988 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.951960    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:19:36.973638 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.973564    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\" (UniqueName: \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\") pod \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") "
Oct 30 03:19:36.973638 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.973635    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\") pod \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\" (UID: \"7cdb6d2e-5233-4365-87e1-9129a7253a6e\") "
Oct 30 03:19:36.975628 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.975597    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs" pod "7cdb6d2e-5233-4365-87e1-9129a7253a6e" (UID: "7cdb6d2e-5233-4365-87e1-9129a7253a6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:19:36.975717 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:36.975680    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx" pod "7cdb6d2e-5233-4365-87e1-9129a7253a6e" (UID: "7cdb6d2e-5233-4365-87e1-9129a7253a6e"). InnerVolumeSpecName "kube-api-access-dwvkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:19:37.037521 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.037490    4869 generic.go:356] "Generic (PLEG): container finished" podID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerID="fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1" exitCode=0
Oct 30 03:19:37.037675 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.037538    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"
Oct 30 03:19:37.037675 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.037588    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" event={"ID":"7cdb6d2e-5233-4365-87e1-9129a7253a6e","Type":"ContainerDied","Data":"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"}
Oct 30 03:19:37.037675 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.037651    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls" event={"ID":"7cdb6d2e-5233-4365-87e1-9129a7253a6e","Type":"ContainerDied","Data":"296c42781bfd0d95e1b8e668b449c7369cfd0914a558ab99ef14d5141c854159"}
Oct 30 03:19:37.037861 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.037679    4869 scope.go:122] "RemoveContainer" containerID="fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"
Oct 30 03:19:37.047267 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.047250    4869 scope.go:122] "RemoveContainer" containerID="fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"
Oct 30 03:19:37.047517 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:19:37.047498    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1\": container with ID starting with fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1 not found: ID does not exist" containerID="fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"
Oct 30 03:19:37.047594 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.047523    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1"} err="failed to get container status \"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1\": rpc error: code = NotFound desc = could not find container \"fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1\": container with ID starting with fa6d479b2939d13773b436ecdc29e533bf69938f8b989934150dd3ddf5fcf4b1 not found: ID does not exist"
Oct 30 03:19:37.075150 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.075122    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwvkx\" (UniqueName: \"kubernetes.io/projected/7cdb6d2e-5233-4365-87e1-9129a7253a6e-kube-api-access-dwvkx\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:19:37.075253 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.075153    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cdb6d2e-5233-4365-87e1-9129a7253a6e-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:19:37.090006 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.089986    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:19:37.093985 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:37.093963    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-router-scheduler-d859b8tzls"]
Oct 30 03:19:38.820245 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:38.820202    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" path="/var/lib/kubelet/pods/7cdb6d2e-5233-4365-87e1-9129a7253a6e/volumes"
Oct 30 03:19:43.371742 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.371704    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:19:43.372299 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.372274    4869 cpu_manager.go:414] "containerMap: removing container" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main"
Oct 30 03:19:43.372466 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.372438    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main"
Oct 30 03:19:43.372666 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.372649    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cdb6d2e-5233-4365-87e1-9129a7253a6e" containerName="main"
Oct 30 03:19:43.377420 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.377400    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.397756 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.397731    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:19:43.421778 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.421746    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.421979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.421940    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fb7\" (UniqueName: \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.469149 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.469121    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"default-dockercfg-z9vmd\""
Oct 30 03:19:43.469288 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.469140    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-c8x92\""
Oct 30 03:19:43.469288 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.469204    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Oct 30 03:19:43.474039 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.474021    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"openshift-service-ca.crt\""
Oct 30 03:19:43.474266 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.474249    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"kube-root-ca.crt\""
Oct 30 03:19:43.522327 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.522301    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.522431 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.522333    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fb7\" (UniqueName: \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.525145 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.525122    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.545624 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.545596    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fb7\" (UniqueName: \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.691924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.691888    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:43.992287 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:43.992246    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:19:43.993281 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:19:43.993249    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267ce250_b610_46fe_addc_892d9791104c.slice/crio-d5dd9e3019cb4f78b4c8720654d1c316010408a8bb992324810a08c2d0658887 WatchSource:0}: Error finding container d5dd9e3019cb4f78b4c8720654d1c316010408a8bb992324810a08c2d0658887: Status 404 returned error can't find the container with id d5dd9e3019cb4f78b4c8720654d1c316010408a8bb992324810a08c2d0658887
Oct 30 03:19:44.085302 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:44.085262    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" event={"ID":"267ce250-b610-46fe-addc-892d9791104c","Type":"ContainerStarted","Data":"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"}
Oct 30 03:19:44.085486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:44.085362    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" event={"ID":"267ce250-b610-46fe-addc-892d9791104c","Type":"ContainerStarted","Data":"d5dd9e3019cb4f78b4c8720654d1c316010408a8bb992324810a08c2d0658887"}
Oct 30 03:19:44.085486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:19:44.085398    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:19:57.820294 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:19:57.820258    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:20:15.094840 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:15.094766    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:20:15.135457 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:15.135401    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podStartSLOduration=32.135385257 podStartE2EDuration="32.135385257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:19:44.128114743 +0000 UTC m=+1453.449694462" watchObservedRunningTime="2026-10-30 03:20:15.135385257 +0000 UTC m=+1484.456964989"
Oct 30 03:20:17.476763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:17.476723    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:20:25.095632 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:25.095561    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:20:27.820167 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:20:27.820133    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:20:30.959387 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:30.959360    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:20:30.966535 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:30.966511    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:20:32.501625 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:32.501568    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main" containerID="cri-o://7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87" gracePeriod=45
Oct 30 03:20:35.094793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:35.094755    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:20:45.095105 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:45.095064    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:20:45.095604 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:45.095164    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:20:55.094762 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:20:55.094727    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:20:57.819785 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:20:57.819751    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:21:02.746320 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.746293    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:21:02.847669 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.847615    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\" (UniqueName: \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\") pod \"267ce250-b610-46fe-addc-892d9791104c\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") "
Oct 30 03:21:02.847786 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.847709    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\" (UniqueName: \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\") pod \"267ce250-b610-46fe-addc-892d9791104c\" (UID: \"267ce250-b610-46fe-addc-892d9791104c\") "
Oct 30 03:21:02.849738 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.849712    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs" pod "267ce250-b610-46fe-addc-892d9791104c" (UID: "267ce250-b610-46fe-addc-892d9791104c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:21:02.849842 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.849825    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7" pod "267ce250-b610-46fe-addc-892d9791104c" (UID: "267ce250-b610-46fe-addc-892d9791104c"). InnerVolumeSpecName "kube-api-access-p8fb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:21:02.948736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.948715    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/267ce250-b610-46fe-addc-892d9791104c-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:21:02.948736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:02.948737    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fb7\" (UniqueName: \"kubernetes.io/projected/267ce250-b610-46fe-addc-892d9791104c-kube-api-access-p8fb7\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:21:03.515343 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.515311    4869 generic.go:356] "Generic (PLEG): container finished" podID="267ce250-b610-46fe-addc-892d9791104c" containerID="7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87" exitCode=0
Oct 30 03:21:03.515499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.515355    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"
Oct 30 03:21:03.515499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.515394    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" event={"ID":"267ce250-b610-46fe-addc-892d9791104c","Type":"ContainerDied","Data":"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"}
Oct 30 03:21:03.515499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.515448    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46" event={"ID":"267ce250-b610-46fe-addc-892d9791104c","Type":"ContainerDied","Data":"d5dd9e3019cb4f78b4c8720654d1c316010408a8bb992324810a08c2d0658887"}
Oct 30 03:21:03.515499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.515470    4869 scope.go:122] "RemoveContainer" containerID="7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"
Oct 30 03:21:03.524718 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.524702    4869 scope.go:122] "RemoveContainer" containerID="7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"
Oct 30 03:21:03.524992 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:21:03.524975    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87\": container with ID starting with 7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87 not found: ID does not exist" containerID="7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"
Oct 30 03:21:03.525058 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.525002    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87"} err="failed to get container status \"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87\": rpc error: code = NotFound desc = could not find container \"7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87\": container with ID starting with 7ba217c6f08b882b61c2a4b897f77ad475513eaa268540a03c37bcf07ad45b87 not found: ID does not exist"
Oct 30 03:21:03.567915 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.567891    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:21:03.578220 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:03.578195    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche7kv46"]
Oct 30 03:21:04.819045 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:04.819009    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="267ce250-b610-46fe-addc-892d9791104c" path="/var/lib/kubelet/pods/267ce250-b610-46fe-addc-892d9791104c/volumes"
Oct 30 03:21:12.318967 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.318931    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:21:12.319572 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.319541    4869 cpu_manager.go:414] "containerMap: removing container" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main"
Oct 30 03:21:12.319789 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.319767    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main"
Oct 30 03:21:12.319935 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.319920    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="267ce250-b610-46fe-addc-892d9791104c" containerName="main"
Oct 30 03:21:12.324472 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.324449    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.343409 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.343385    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:21:12.351846 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.351815    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Oct 30 03:21:12.351971 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.351891    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-hmtsn\""
Oct 30 03:21:12.351971 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.351939    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Oct 30 03:21:12.352070 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.351977    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Oct 30 03:21:12.352070 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.352037    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-wg8tb\""
Oct 30 03:21:12.417793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.417767    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.417926 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.417816    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qt6\" (UniqueName: \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.519114 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.519087    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.519249 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.519140    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qt6\" (UniqueName: \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.521544 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.521521    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.541684 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.541657    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qt6\" (UniqueName: \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.638638 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.638550    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:12.948072 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:12.948039    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:21:12.949824 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:21:12.949783    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce13a37_7696_4c2f_8242_5d8b86221ed4.slice/crio-b158bd811a40f74ab52a46f6b0415b3fbac5cb8871eb0edc499d649eb544241c WatchSource:0}: Error finding container b158bd811a40f74ab52a46f6b0415b3fbac5cb8871eb0edc499d649eb544241c: Status 404 returned error can't find the container with id b158bd811a40f74ab52a46f6b0415b3fbac5cb8871eb0edc499d649eb544241c
Oct 30 03:21:13.577018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:13.576414    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" event={"ID":"1ce13a37-7696-4c2f-8242-5d8b86221ed4","Type":"ContainerStarted","Data":"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"}
Oct 30 03:21:13.577018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:13.576484    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" event={"ID":"1ce13a37-7696-4c2f-8242-5d8b86221ed4","Type":"ContainerStarted","Data":"b158bd811a40f74ab52a46f6b0415b3fbac5cb8871eb0edc499d649eb544241c"}
Oct 30 03:21:13.577018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:13.576737    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:16.746784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:16.746727    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podStartSLOduration=4.74671111 podStartE2EDuration="4.74671111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:21:13.626034146 +0000 UTC m=+1542.947613866" watchObservedRunningTime="2026-10-30 03:21:16.74671111 +0000 UTC m=+1546.068290830"
Oct 30 03:21:16.748134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:16.748107    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:21:22.752890 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:22.752853    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:21:27.819938 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:21:27.819902    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:21:31.768001 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:31.767958    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main" containerID="cri-o://12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328" gracePeriod=45
Oct 30 03:21:32.752124 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:32.752086    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:21:42.752129 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:42.752093    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:21:42.752618 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:42.752212    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:21:44.586017 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:44.585943    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:21:46.892354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:46.845487    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:21:52.752011 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:52.751970    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:21:54.586046 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:21:54.586009    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:21:57.821195 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:21:57.821158    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:22:01.937422 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:01.937384    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main" containerID="cri-o://80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51" gracePeriod=45
Oct 30 03:22:02.032181 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.032128    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:22:02.122014 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.121986    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\") pod \"bfcdb821-a85c-49af-ad27-1a41c99b0326\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") "
Oct 30 03:22:02.122158 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.122118    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\" (UniqueName: \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\") pod \"bfcdb821-a85c-49af-ad27-1a41c99b0326\" (UID: \"bfcdb821-a85c-49af-ad27-1a41c99b0326\") "
Oct 30 03:22:02.124119 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.124088    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs" pod "bfcdb821-a85c-49af-ad27-1a41c99b0326" (UID: "bfcdb821-a85c-49af-ad27-1a41c99b0326"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:22:02.124223 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.124144    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf" pod "bfcdb821-a85c-49af-ad27-1a41c99b0326" (UID: "bfcdb821-a85c-49af-ad27-1a41c99b0326"). InnerVolumeSpecName "kube-api-access-vpxvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:22:02.223475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.223436    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpxvf\" (UniqueName: \"kubernetes.io/projected/bfcdb821-a85c-49af-ad27-1a41c99b0326-kube-api-access-vpxvf\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:22:02.223475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.223469    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcdb821-a85c-49af-ad27-1a41c99b0326-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:22:02.847261 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.847235    4869 generic.go:356] "Generic (PLEG): container finished" podID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerID="12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328" exitCode=0
Oct 30 03:22:02.847400 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.847296    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"
Oct 30 03:22:02.847400 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.847315    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" event={"ID":"bfcdb821-a85c-49af-ad27-1a41c99b0326","Type":"ContainerDied","Data":"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"}
Oct 30 03:22:02.847400 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.847371    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx" event={"ID":"bfcdb821-a85c-49af-ad27-1a41c99b0326","Type":"ContainerDied","Data":"706810026de88f9a94e655ceb6690c0dfcb3b8a2069aa13b9db39b5d3c56122c"}
Oct 30 03:22:02.847562 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.847401    4869 scope.go:122] "RemoveContainer" containerID="12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"
Oct 30 03:22:02.855568 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.855550    4869 scope.go:122] "RemoveContainer" containerID="12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"
Oct 30 03:22:02.855873 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:22:02.855854    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328\": container with ID starting with 12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328 not found: ID does not exist" containerID="12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"
Oct 30 03:22:02.855942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.855884    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328"} err="failed to get container status \"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328\": rpc error: code = NotFound desc = could not find container \"12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328\": container with ID starting with 12f273ab178db6b75ce664c22e9126a8888ccdf8cfb381b5df2945c8a286c328 not found: ID does not exist"
Oct 30 03:22:02.897404 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.897381    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:22:02.908839 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:02.908816    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-cpu-accelerator-preset-serves-inference-a4a93d2c/test-cpb25a14c9ba423627edeb5388343bd353-kserve-router-schefzlzx"]
Oct 30 03:22:04.586463 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:04.586425    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:22:04.819593 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:04.819544    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" path="/var/lib/kubelet/pods/bfcdb821-a85c-49af-ad27-1a41c99b0326/volumes"
Oct 30 03:22:11.321420 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.321382    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:22:11.322037 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.322016    4869 cpu_manager.go:414] "containerMap: removing container" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main"
Oct 30 03:22:11.322135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.322038    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main"
Oct 30 03:22:11.322186 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.322137    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfcdb821-a85c-49af-ad27-1a41c99b0326" containerName="main"
Oct 30 03:22:11.326741 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.326719    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.343997 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.343974    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"openshift-service-ca.crt\""
Oct 30 03:22:11.344489 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.344439    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"kube-root-ca.crt\""
Oct 30 03:22:11.355984 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.355958    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-epp-sa-dockercfg-m7wl7\""
Oct 30 03:22:11.356091 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.356059    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"default-dockercfg-6lnhh\""
Oct 30 03:22:11.356091 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.356086    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-kserve-self-signed-certs\""
Oct 30 03:22:11.358279 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.358258    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:22:11.489439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.489403    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjb8l\" (UniqueName: \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.489673 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.489523    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.590755 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.590680    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjb8l\" (UniqueName: \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.590755 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.590748    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.593217 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.593193    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.613449 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.613427    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjb8l\" (UniqueName: \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\") pod \"fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.640670 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.640646    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:11.947789 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:11.947764    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:22:11.949524 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:22:11.949498    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5 WatchSource:0}: Error finding container 2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5: Status 404 returned error can't find the container with id 2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5
Oct 30 03:22:12.903491 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:12.903452    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" event={"ID":"cbf9fcfb-4859-4a10-a411-f033da61fc9c","Type":"ContainerStarted","Data":"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"}
Oct 30 03:22:12.903905 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:12.903598    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:12.903905 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:12.903634    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" event={"ID":"cbf9fcfb-4859-4a10-a411-f033da61fc9c","Type":"ContainerStarted","Data":"2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5"}
Oct 30 03:22:12.945168 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:12.945126    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podStartSLOduration=1.945113472 podStartE2EDuration="1.945113472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:22:12.942935155 +0000 UTC m=+1602.264514874" watchObservedRunningTime="2026-10-30 03:22:12.945113472 +0000 UTC m=+1602.266693191"
Oct 30 03:22:14.586081 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:14.586043    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:22:14.586689 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:14.586140    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:22:24.585721 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:24.585682    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:22:27.819700 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:22:27.819664    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:22:32.196400 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.196376    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:22:32.239737 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.239687    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\" (UniqueName: \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\") pod \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") "
Oct 30 03:22:32.239852 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.239790    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\") pod \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\" (UID: \"1ce13a37-7696-4c2f-8242-5d8b86221ed4\") "
Oct 30 03:22:32.241911 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.241885    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6" pod "1ce13a37-7696-4c2f-8242-5d8b86221ed4" (UID: "1ce13a37-7696-4c2f-8242-5d8b86221ed4"). InnerVolumeSpecName "kube-api-access-q2qt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:22:32.243977 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.243951    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs" pod "1ce13a37-7696-4c2f-8242-5d8b86221ed4" (UID: "1ce13a37-7696-4c2f-8242-5d8b86221ed4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:22:32.340526 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.340503    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce13a37-7696-4c2f-8242-5d8b86221ed4-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:22:32.340640 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:32.340527    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2qt6\" (UniqueName: \"kubernetes.io/projected/1ce13a37-7696-4c2f-8242-5d8b86221ed4-kube-api-access-q2qt6\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:22:33.007051 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.007022    4869 generic.go:356] "Generic (PLEG): container finished" podID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerID="80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51" exitCode=0
Oct 30 03:22:33.007200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.007073    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"
Oct 30 03:22:33.007200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.007125    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" event={"ID":"1ce13a37-7696-4c2f-8242-5d8b86221ed4","Type":"ContainerDied","Data":"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"}
Oct 30 03:22:33.007200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.007185    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt" event={"ID":"1ce13a37-7696-4c2f-8242-5d8b86221ed4","Type":"ContainerDied","Data":"b158bd811a40f74ab52a46f6b0415b3fbac5cb8871eb0edc499d649eb544241c"}
Oct 30 03:22:33.007329 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.007210    4869 scope.go:122] "RemoveContainer" containerID="80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"
Oct 30 03:22:33.020867 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.020836    4869 scope.go:122] "RemoveContainer" containerID="80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"
Oct 30 03:22:33.021141 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:22:33.021118    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51\": container with ID starting with 80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51 not found: ID does not exist" containerID="80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"
Oct 30 03:22:33.021199 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.021149    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51"} err="failed to get container status \"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51\": rpc error: code = NotFound desc = could not find container \"80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51\": container with ID starting with 80f6dad36a0a6f384aff2c47a9b9a6d02886372e8fa3454b17971f08aa5d0b51 not found: ID does not exist"
Oct 30 03:22:33.057416 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.057386    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:22:33.068918 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:33.068887    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-7599bsfjzt"]
Oct 30 03:22:34.819364 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:34.819328    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" path="/var/lib/kubelet/pods/1ce13a37-7696-4c2f-8242-5d8b86221ed4/volumes"
Oct 30 03:22:39.528011 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.527979    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:22:39.528510 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.528383    4869 cpu_manager.go:414] "containerMap: removing container" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main"
Oct 30 03:22:39.528510 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.528395    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main"
Oct 30 03:22:39.528510 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.528479    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ce13a37-7696-4c2f-8242-5d8b86221ed4" containerName="main"
Oct 30 03:22:39.533384 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.533360    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.563042 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.563017    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"kube-root-ca.crt\""
Oct 30 03:22:39.563209 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.563021    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"openshift-service-ca.crt\""
Oct 30 03:22:39.563309 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.563118    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"default-dockercfg-7zh75\""
Oct 30 03:22:39.563309 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.563244    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Oct 30 03:22:39.563469 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.563254    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-zdvmn\""
Oct 30 03:22:39.567113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.567087    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:22:39.591973 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.591939    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.592121 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.592004    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p9pj\" (UniqueName: \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.693334 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.693300    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p9pj\" (UniqueName: \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.693501 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.693485    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.696073 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.696048    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.716623 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.716592    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p9pj\" (UniqueName: \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:39.848025 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:39.847931    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:40.158471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:40.158443    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:22:40.159510 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:22:40.159471    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742 WatchSource:0}: Error finding container dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742: Status 404 returned error can't find the container with id dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742
Oct 30 03:22:41.049808 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:41.049769    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" event={"ID":"147f9707-c98c-4700-8723-8547ae165492","Type":"ContainerStarted","Data":"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"}
Oct 30 03:22:41.050232 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:41.049835    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" event={"ID":"147f9707-c98c-4700-8723-8547ae165492","Type":"ContainerStarted","Data":"dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742"}
Oct 30 03:22:41.050232 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:41.049868    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:22:41.092227 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:41.092175    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podStartSLOduration=2.092160338 podStartE2EDuration="2.092160338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:22:41.090668825 +0000 UTC m=+1630.412248563" watchObservedRunningTime="2026-10-30 03:22:41.092160338 +0000 UTC m=+1630.413740089"
Oct 30 03:22:43.911110 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:43.911082    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:22:51.774449 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:51.774407    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:22:53.911131 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:22:53.911093    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:22:57.819968 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:22:57.819934    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:23:03.910659 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:03.910617    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:06.798456 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:06.798390    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" containerID="cri-o://61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015" gracePeriod=45
Oct 30 03:23:12.056995 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:12.056963    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:23:13.910725 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:13.910643    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:13.911082 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:13.910750    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:23:14.390513 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:14.390479    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:23:22.057706 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:22.057668    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:23.911167 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:23.911123    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:27.819769 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:27.819735    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:23:29.417676 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:29.417622    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main" containerID="cri-o://4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16" gracePeriod=45
Oct 30 03:23:32.057744 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:32.057704    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:33.911283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:33.911239    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:37.054240 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.054215    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:23:37.149900 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.149837    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\") pod \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") "
Oct 30 03:23:37.150016 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.149900    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\" (UniqueName: \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\") pod \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\" (UID: \"cbf9fcfb-4859-4a10-a411-f033da61fc9c\") "
Oct 30 03:23:37.151937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.151912    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l" pod "cbf9fcfb-4859-4a10-a411-f033da61fc9c" (UID: "cbf9fcfb-4859-4a10-a411-f033da61fc9c"). InnerVolumeSpecName "kube-api-access-tjb8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:23:37.152034 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.151937    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs" pod "cbf9fcfb-4859-4a10-a411-f033da61fc9c" (UID: "cbf9fcfb-4859-4a10-a411-f033da61fc9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:23:37.250900 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.250875    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbf9fcfb-4859-4a10-a411-f033da61fc9c-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:23:37.250900 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.250897    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjb8l\" (UniqueName: \"kubernetes.io/projected/cbf9fcfb-4859-4a10-a411-f033da61fc9c-kube-api-access-tjb8l\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:23:37.352127 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.352100    4869 generic.go:356] "Generic (PLEG): container finished" podID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerID="61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015" exitCode=0
Oct 30 03:23:37.352219 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.352153    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"
Oct 30 03:23:37.352219 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.352182    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" event={"ID":"cbf9fcfb-4859-4a10-a411-f033da61fc9c","Type":"ContainerDied","Data":"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"}
Oct 30 03:23:37.352291 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.352234    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h" event={"ID":"cbf9fcfb-4859-4a10-a411-f033da61fc9c","Type":"ContainerDied","Data":"2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5"}
Oct 30 03:23:37.352291 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.352256    4869 scope.go:122] "RemoveContainer" containerID="61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"
Oct 30 03:23:37.364588 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.364448    4869 scope.go:122] "RemoveContainer" containerID="61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"
Oct 30 03:23:37.364867 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:37.364843    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015\": container with ID starting with 61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015 not found: ID does not exist" containerID="61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"
Oct 30 03:23:37.364937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.364879    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015"} err="failed to get container status \"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015\": rpc error: code = NotFound desc = could not find container \"61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015\": container with ID starting with 61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015 not found: ID does not exist"
Oct 30 03:23:37.401805 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.401751    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:23:37.413391 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:37.413364    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-77fbbb774b-5w55h"]
Oct 30 03:23:38.818794 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:38.818759    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" path="/var/lib/kubelet/pods/cbf9fcfb-4859-4a10-a411-f033da61fc9c/volumes"
Oct 30 03:23:42.057432 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:42.057399    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:42.057920 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:42.057494    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:23:46.241030 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.240996    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:23:46.242160 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.242136    4869 cpu_manager.go:414] "containerMap: removing container" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main"
Oct 30 03:23:46.242160 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.242161    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main"
Oct 30 03:23:46.242327 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.242256    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbf9fcfb-4859-4a10-a411-f033da61fc9c" containerName="main"
Oct 30 03:23:46.246524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.246501    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.274080 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.274051    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"kube-root-ca.crt\""
Oct 30 03:23:46.274222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.274108    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"default-dockercfg-k8lxx\""
Oct 30 03:23:46.274222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.274144    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-epp-sa-dockercfg-jlxr4\""
Oct 30 03:23:46.274222 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.274193    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"openshift-service-ca.crt\""
Oct 30 03:23:46.274402 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.274246    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-kserve-self-signed-certs\""
Oct 30 03:23:46.276296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.276270    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:23:46.321159 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.321130    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.321307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.321198    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ckg\" (UniqueName: \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.421664 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.421626    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ckg\" (UniqueName: \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.421801 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.421721    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.424133 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.424104    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.444539 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.444514    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ckg\" (UniqueName: \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\") pod \"fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.566128 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.566064    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:46.884257 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:46.884184    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:23:47.405633 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:47.405595    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" event={"ID":"77cc04cc-6529-4f62-8b63-3196b3fe1ed5","Type":"ContainerStarted","Data":"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"}
Oct 30 03:23:47.406038 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:47.405659    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" event={"ID":"77cc04cc-6529-4f62-8b63-3196b3fe1ed5","Type":"ContainerStarted","Data":"5928e598dc7f57a8c0d809b5d2c0d291f5b70068745fea2a70f9d79cd4c9e677"}
Oct 30 03:23:47.406038 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:47.405701    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:23:47.460285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:47.460235    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podStartSLOduration=1.460221722 podStartE2EDuration="1.460221722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:23:47.457227047 +0000 UTC m=+1696.778806768" watchObservedRunningTime="2026-10-30 03:23:47.460221722 +0000 UTC m=+1696.781801441"
Oct 30 03:23:52.057570 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:52.057535    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:23:54.738693 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:54.738643    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-conmon-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-conmon-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5\": RecentStats: unable to find data in memory cache]"
Oct 30 03:23:54.739087 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:54.738726    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-conmon-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-conmon-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:23:54.739087 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:54.738780    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-conmon-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-conmon-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 03:23:54.739087 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:54.738792    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-2f38ac1182b183f45e9262b14c4eda0aa8f5a34adde88b5f8b4d10742e7cf3e5\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-conmon-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9fcfb_4859_4a10_a411_f033da61fc9c.slice/crio-61195ddbc1ac38172046116ad1e535bebd9f99d5b26a26799fb1da3f89697015.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147f9707_c98c_4700_8723_8547ae165492.slice/crio-conmon-4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:23:54.877237 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.877214    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8_147f9707-c98c-4700-8723-8547ae165492/main/0.log"
Oct 30 03:23:54.879603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.879556    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:23:54.888178 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.888159    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\" (UniqueName: \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\") pod \"147f9707-c98c-4700-8723-8547ae165492\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") "
Oct 30 03:23:54.888269 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.888237    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\" (UniqueName: \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\") pod \"147f9707-c98c-4700-8723-8547ae165492\" (UID: \"147f9707-c98c-4700-8723-8547ae165492\") "
Oct 30 03:23:54.890381 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.890354    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj" pod "147f9707-c98c-4700-8723-8547ae165492" (UID: "147f9707-c98c-4700-8723-8547ae165492"). InnerVolumeSpecName "kube-api-access-6p9pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:23:54.890479 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.890398    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs" pod "147f9707-c98c-4700-8723-8547ae165492" (UID: "147f9707-c98c-4700-8723-8547ae165492"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:23:54.989708 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.989651    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147f9707-c98c-4700-8723-8547ae165492-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:23:54.989708 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:54.989678    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p9pj\" (UniqueName: \"kubernetes.io/projected/147f9707-c98c-4700-8723-8547ae165492-kube-api-access-6p9pj\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:23:55.447128 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447102    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-2541cd65_scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8_147f9707-c98c-4700-8723-8547ae165492/main/0.log"
Oct 30 03:23:55.447296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447146    4869 generic.go:356] "Generic (PLEG): container finished" podID="147f9707-c98c-4700-8723-8547ae165492" containerID="4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16" exitCode=1
Oct 30 03:23:55.447296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447196    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"
Oct 30 03:23:55.447296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447244    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" event={"ID":"147f9707-c98c-4700-8723-8547ae165492","Type":"ContainerDied","Data":"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"}
Oct 30 03:23:55.447397 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447305    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8" event={"ID":"147f9707-c98c-4700-8723-8547ae165492","Type":"ContainerDied","Data":"dd7e678ff2993af203d4b76d76fb6c078a37404f723d824852861f2b78f28742"}
Oct 30 03:23:55.447397 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.447331    4869 scope.go:122] "RemoveContainer" containerID="4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"
Oct 30 03:23:55.456959 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.456942    4869 scope.go:122] "RemoveContainer" containerID="4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"
Oct 30 03:23:55.457241 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:55.457223    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16\": container with ID starting with 4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16 not found: ID does not exist" containerID="4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"
Oct 30 03:23:55.457318 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.457267    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16"} err="failed to get container status \"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16\": rpc error: code = NotFound desc = could not find container \"4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16\": container with ID starting with 4d24a8a306f013bb912a0060995064050fbbe7b3cf9db48a27ef809539471a16 not found: ID does not exist"
Oct 30 03:23:55.497429 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.497403    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:23:55.509109 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:55.509090    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-84865b6krhq8"]
Oct 30 03:23:56.818562 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:23:56.818527    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="147f9707-c98c-4700-8723-8547ae165492" path="/var/lib/kubelet/pods/147f9707-c98c-4700-8723-8547ae165492/volumes"
Oct 30 03:23:57.819247 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:23:57.819206    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:24:09.519475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.519443    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:24:09.520318 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.520295    4869 cpu_manager.go:414] "containerMap: removing container" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main"
Oct 30 03:24:09.520416 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.520322    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main"
Oct 30 03:24:09.520457 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.520418    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="147f9707-c98c-4700-8723-8547ae165492" containerName="main"
Oct 30 03:24:09.525436 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.525416    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.543515 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.543490    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:24:09.551981 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.551955    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"kube-root-ca.crt\""
Oct 30 03:24:09.551981 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.551964    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"openshift-service-ca.crt\""
Oct 30 03:24:09.552152 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.552061    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"scheduler-custom-template-test-epp-sa-dockercfg-cjlhp\""
Oct 30 03:24:09.552152 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.552141    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"default-dockercfg-sxsgc\""
Oct 30 03:24:09.552238 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.552185    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-35377f35\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Oct 30 03:24:09.605761 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.605738    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.605882 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.605773    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26h9\" (UniqueName: \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.605882 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.605800    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.605961 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.605903    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.706891 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.706863    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.707032 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.706901    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.707032 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.706968    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.707032 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.706990    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26h9\" (UniqueName: \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.707312 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.707294    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.707365 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.707343    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.709230 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.709209    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.729645 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.729624    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26h9\" (UniqueName: \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\") pod \"scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") " pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:09.840476 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:09.840400    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:10.140285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:10.140258    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:24:10.142168 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:24:10.142137    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2870b75_211d_4d1c_8d33_3880d8917aa0.slice/crio-26fe97c7de881f9a4464238d13da6b7d0fbb1970d2198fe13780450ab6764ac6 WatchSource:0}: Error finding container 26fe97c7de881f9a4464238d13da6b7d0fbb1970d2198fe13780450ab6764ac6: Status 404 returned error can't find the container with id 26fe97c7de881f9a4464238d13da6b7d0fbb1970d2198fe13780450ab6764ac6
Oct 30 03:24:10.531594 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:10.531548    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" event={"ID":"c2870b75-211d-4d1c-8d33-3880d8917aa0","Type":"ContainerStarted","Data":"a41c410f843b2f9dceb2977b92a9f3732601a03182e7280920a7b5e6ee977715"}
Oct 30 03:24:10.531958 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:10.531642    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" event={"ID":"c2870b75-211d-4d1c-8d33-3880d8917aa0","Type":"ContainerStarted","Data":"26fe97c7de881f9a4464238d13da6b7d0fbb1970d2198fe13780450ab6764ac6"}
Oct 30 03:24:10.531958 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:10.531776    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:10.573430 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:10.573385    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podStartSLOduration=1.5733702269999998 podStartE2EDuration="1.573370227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:24:10.572312474 +0000 UTC m=+1719.893892193" watchObservedRunningTime="2026-10-30 03:24:10.573370227 +0000 UTC m=+1719.894949947"
Oct 30 03:24:18.412533 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:18.412499    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:24:19.842172 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:24:19.842138    4869 logging.go:55] [core] [Channel #251 SubChannel #252]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.59:9003", ServerName: "10.132.0.59:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.59:9003: connect: connection refused"
Oct 30 03:24:20.841811 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:20.841770    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.59:9003\" within 1s: context deadline exceeded"
Oct 30 03:24:25.893331 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:25.893294    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:24:27.820032 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:24:27.819997    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:24:28.413059 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:28.413020    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:24:29.841165 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:24:29.841138    4869 logging.go:55] [core] [Channel #256 SubChannel #257]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.59:9003", ServerName: "10.132.0.59:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.59:9003: connect: connection refused"
Oct 30 03:24:30.844607 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:30.841657    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.59:9003\" within 1s: context deadline exceeded"
Oct 30 03:24:38.412244 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:38.412206    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:24:40.913500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:40.913456    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" containerID="cri-o://3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13" gracePeriod=45
Oct 30 03:24:41.539245 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:41.539215    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:24:43.701104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:43.700866    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:24:48.412150 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:48.412112    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:24:48.412538 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:48.412228    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:24:51.539087 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:51.539048    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:24:57.820087 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:24:57.820048    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:24:58.412539 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:58.412500    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:24:58.741184 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:24:58.741154    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" containerID="cri-o://a41c410f843b2f9dceb2977b92a9f3732601a03182e7280920a7b5e6ee977715" gracePeriod=45
Oct 30 03:25:01.538994 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:01.538957    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:25:08.412483 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:08.412444    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:25:11.186380 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.186353    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:25:11.293383 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.293350    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\" (UniqueName: \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\") pod \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") "
Oct 30 03:25:11.293553 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.293451    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\" (UniqueName: \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\") pod \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\" (UID: \"77cc04cc-6529-4f62-8b63-3196b3fe1ed5\") "
Oct 30 03:25:11.295611 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.295555    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs" pod "77cc04cc-6529-4f62-8b63-3196b3fe1ed5" (UID: "77cc04cc-6529-4f62-8b63-3196b3fe1ed5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:25:11.295724 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.295649    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg" pod "77cc04cc-6529-4f62-8b63-3196b3fe1ed5" (UID: "77cc04cc-6529-4f62-8b63-3196b3fe1ed5"). InnerVolumeSpecName "kube-api-access-k4ckg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:25:11.394439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.394417    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:11.394439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.394439    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4ckg\" (UniqueName: \"kubernetes.io/projected/77cc04cc-6529-4f62-8b63-3196b3fe1ed5-kube-api-access-k4ckg\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:11.539651 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.539623    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:25:11.539769 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.539735    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:25:11.863283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.863209    4869 generic.go:356] "Generic (PLEG): container finished" podID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerID="3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13" exitCode=0
Oct 30 03:25:11.863283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.863249    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" event={"ID":"77cc04cc-6529-4f62-8b63-3196b3fe1ed5","Type":"ContainerDied","Data":"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"}
Oct 30 03:25:11.863283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.863251    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"
Oct 30 03:25:11.863283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.863282    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7" event={"ID":"77cc04cc-6529-4f62-8b63-3196b3fe1ed5","Type":"ContainerDied","Data":"5928e598dc7f57a8c0d809b5d2c0d291f5b70068745fea2a70f9d79cd4c9e677"}
Oct 30 03:25:11.863555 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.863303    4869 scope.go:122] "RemoveContainer" containerID="3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"
Oct 30 03:25:11.873529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.873513    4869 scope.go:122] "RemoveContainer" containerID="3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"
Oct 30 03:25:11.873795 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:25:11.873779    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13\": container with ID starting with 3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13 not found: ID does not exist" containerID="3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"
Oct 30 03:25:11.873847 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.873801    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13"} err="failed to get container status \"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13\": rpc error: code = NotFound desc = could not find container \"3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13\": container with ID starting with 3cc3572fe1d73ce1486efd81441cf8f8e05e455cc8d32f4cc49a8137e3606c13 not found: ID does not exist"
Oct 30 03:25:11.913360 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.913338    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:25:11.924730 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:11.924707    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-7db7c65fd7-nv2g7"]
Oct 30 03:25:12.820104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:12.820069    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" path="/var/lib/kubelet/pods/77cc04cc-6529-4f62-8b63-3196b3fe1ed5/volumes"
Oct 30 03:25:21.539544 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:21.539508    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:25:27.819778 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:25:27.819737    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:25:28.954392 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:28.954361    4869 generic.go:356] "Generic (PLEG): container finished" podID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerID="a41c410f843b2f9dceb2977b92a9f3732601a03182e7280920a7b5e6ee977715" exitCode=0
Oct 30 03:25:28.954846 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:28.954440    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" event={"ID":"c2870b75-211d-4d1c-8d33-3880d8917aa0","Type":"ContainerDied","Data":"a41c410f843b2f9dceb2977b92a9f3732601a03182e7280920a7b5e6ee977715"}
Oct 30 03:25:29.009974 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.009920    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:25:29.140925 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.140894    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\") pod \"c2870b75-211d-4d1c-8d33-3880d8917aa0\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") "
Oct 30 03:25:29.141069 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.140942    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\") pod \"c2870b75-211d-4d1c-8d33-3880d8917aa0\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") "
Oct 30 03:25:29.141069 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.140967    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\") pod \"c2870b75-211d-4d1c-8d33-3880d8917aa0\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") "
Oct 30 03:25:29.141069 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.141003    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\" (UniqueName: \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\") pod \"c2870b75-211d-4d1c-8d33-3880d8917aa0\" (UID: \"c2870b75-211d-4d1c-8d33-3880d8917aa0\") "
Oct 30 03:25:29.141209 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.141180    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache" pod "c2870b75-211d-4d1c-8d33-3880d8917aa0" (UID: "c2870b75-211d-4d1c-8d33-3880d8917aa0"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:25:29.141292 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.141267    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache" pod "c2870b75-211d-4d1c-8d33-3880d8917aa0" (UID: "c2870b75-211d-4d1c-8d33-3880d8917aa0"). InnerVolumeSpecName "cachi2-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:25:29.143251 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.143225    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9" pod "c2870b75-211d-4d1c-8d33-3880d8917aa0" (UID: "c2870b75-211d-4d1c-8d33-3880d8917aa0"). InnerVolumeSpecName "kube-api-access-x26h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:25:29.143361 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.143255    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs" pod "c2870b75-211d-4d1c-8d33-3880d8917aa0" (UID: "c2870b75-211d-4d1c-8d33-3880d8917aa0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:25:29.241928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.241902    4869 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-tokenizer-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:29.241928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.241926    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2870b75-211d-4d1c-8d33-3880d8917aa0-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:29.242077 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.241936    4869 reconciler_common.go:299] "Volume detached for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2870b75-211d-4d1c-8d33-3880d8917aa0-cachi2-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:29.242077 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.241944    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x26h9\" (UniqueName: \"kubernetes.io/projected/c2870b75-211d-4d1c-8d33-3880d8917aa0-kube-api-access-x26h9\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:25:29.968275 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.968236    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"
Oct 30 03:25:29.968275 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.968246    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx" event={"ID":"c2870b75-211d-4d1c-8d33-3880d8917aa0","Type":"ContainerDied","Data":"26fe97c7de881f9a4464238d13da6b7d0fbb1970d2198fe13780450ab6764ac6"}
Oct 30 03:25:29.968831 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:29.968345    4869 scope.go:122] "RemoveContainer" containerID="a41c410f843b2f9dceb2977b92a9f3732601a03182e7280920a7b5e6ee977715"
Oct 30 03:25:30.019405 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:30.019380    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:25:30.031076 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:30.031050    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-35377f35/scheduler-custom-template-test-kserve-router-scheduler-bd58dmgx"]
Oct 30 03:25:30.819541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:30.819509    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" path="/var/lib/kubelet/pods/c2870b75-211d-4d1c-8d33-3880d8917aa0/volumes"
Oct 30 03:25:30.996490 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:30.996463    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:25:31.004352 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:31.004329    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:25:37.244244 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.244202    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:25:37.244888 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.244867    4869 cpu_manager.go:414] "containerMap: removing container" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main"
Oct 30 03:25:37.244942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.244892    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main"
Oct 30 03:25:37.244942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.244911    4869 cpu_manager.go:414] "containerMap: removing container" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main"
Oct 30 03:25:37.244942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.244918    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main"
Oct 30 03:25:37.245050 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.245007    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2870b75-211d-4d1c-8d33-3880d8917aa0" containerName="main"
Oct 30 03:25:37.245050 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.245027    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="77cc04cc-6529-4f62-8b63-3196b3fe1ed5" containerName="main"
Oct 30 03:25:37.249858 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.249834    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.266497 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.266467    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:25:37.275867 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.275846    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"default-dockercfg-nf54q\""
Oct 30 03:25:37.276532 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.276510    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"openshift-service-ca.crt\""
Oct 30 03:25:37.276689 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.276574    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"kube-root-ca.crt\""
Oct 30 03:25:37.276689 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.276607    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-epp-sa-dockercfg-wvz4t\""
Oct 30 03:25:37.276873 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.276623    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-kserve-self-signed-certs\""
Oct 30 03:25:37.314405 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.314381    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxf5\" (UniqueName: \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.314542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.314441    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.415526 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.415499    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxf5\" (UniqueName: \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.415671 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.415540    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.418042 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.418016    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.437964 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.437941    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxf5\" (UniqueName: \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\") pod \"auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.565151 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.565072    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:37.863471 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:37.863444    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:25:37.865430 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:25:37.865404    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7961eeb3_1510_49bc_83e6_aeadd7625f91.slice/crio-ae7541a26e80283cd0ce264334e0b2f1844f382a842f59d1b0d7721902cb65c4 WatchSource:0}: Error finding container ae7541a26e80283cd0ce264334e0b2f1844f382a842f59d1b0d7721902cb65c4: Status 404 returned error can't find the container with id ae7541a26e80283cd0ce264334e0b2f1844f382a842f59d1b0d7721902cb65c4
Oct 30 03:25:38.015690 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:38.015659    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" event={"ID":"7961eeb3-1510-49bc-83e6-aeadd7625f91","Type":"ContainerStarted","Data":"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"}
Oct 30 03:25:38.015851 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:38.015713    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" event={"ID":"7961eeb3-1510-49bc-83e6-aeadd7625f91","Type":"ContainerStarted","Data":"ae7541a26e80283cd0ce264334e0b2f1844f382a842f59d1b0d7721902cb65c4"}
Oct 30 03:25:38.015851 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:38.015747    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:25:38.056902 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:25:38.056857    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podStartSLOduration=1.056844586 podStartE2EDuration="1.056844586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:25:38.054529171 +0000 UTC m=+1807.376108889" watchObservedRunningTime="2026-10-30 03:25:38.056844586 +0000 UTC m=+1807.378424305"
Oct 30 03:25:57.818829 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:25:57.818783    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:26:09.038287 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:26:09.038256    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:26:27.819633 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:26:27.819597    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:26:57.819906 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:26:57.819868    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:27:27.819962 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:27:27.819926    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:27:46.061687 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.061609    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:27:46.065276 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.065246    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.080352 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.080330    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"kube-root-ca.crt\""
Oct 30 03:27:46.092161 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.092135    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"openshift-service-ca.crt\""
Oct 30 03:27:46.092354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.092306    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-epp-sa-dockercfg-t2j4b\""
Oct 30 03:27:46.092491 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.092418    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Oct 30 03:27:46.094639 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.094616    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:27:46.180005 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.179976    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"default-dockercfg-gsg7j\""
Oct 30 03:27:46.222362 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.222334    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxs4\" (UniqueName: \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.222475 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.222380    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.323055 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.322979    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxs4\" (UniqueName: \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.323055 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.323026    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.325423 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.325394    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.345637 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.345612    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxs4\" (UniqueName: \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.381149 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.381120    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:46.709701 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.709673    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:27:46.711596 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:27:46.711550    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99085779_a787_4a41_8bbe_53e6fc48020c.slice/crio-ae9179bc061cbe6df074d36d2ac116ed4e7a52296ef4797fec72da9394b3da81 WatchSource:0}: Error finding container ae9179bc061cbe6df074d36d2ac116ed4e7a52296ef4797fec72da9394b3da81: Status 404 returned error can't find the container with id ae9179bc061cbe6df074d36d2ac116ed4e7a52296ef4797fec72da9394b3da81
Oct 30 03:27:46.767696 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:46.767665    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" event={"ID":"99085779-a787-4a41-8bbe-53e6fc48020c","Type":"ContainerStarted","Data":"ae9179bc061cbe6df074d36d2ac116ed4e7a52296ef4797fec72da9394b3da81"}
Oct 30 03:27:47.774731 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:47.774693    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" event={"ID":"99085779-a787-4a41-8bbe-53e6fc48020c","Type":"ContainerStarted","Data":"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"}
Oct 30 03:27:47.775135 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:47.774828    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:27:47.816997 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:27:47.816949    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podStartSLOduration=1.8169366139999998 podStartE2EDuration="1.816936614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:27:47.815145483 +0000 UTC m=+1937.136725202" watchObservedRunningTime="2026-10-30 03:27:47.816936614 +0000 UTC m=+1937.138516311"
Oct 30 03:27:57.820295 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:27:57.820258    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:28:14.106803 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:14.106769    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:28:18.781741 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:18.781711    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:28:19.037561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:19.037465    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:28:27.821849 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:28:27.821810    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:28:29.037376 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:29.037334    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:28:29.127181 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:29.127148    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" containerID="cri-o://24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b" gracePeriod=45
Oct 30 03:28:39.037591 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:39.037537    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:28:39.038113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:39.037669    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:28:49.037784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:49.037743    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:28:57.819405 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:28:57.819369    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:28:59.037527 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.037490    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:28:59.375749 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.375722    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:28:59.500151 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.500108    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\" (UniqueName: \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\") pod \"7961eeb3-1510-49bc-83e6-aeadd7625f91\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") "
Oct 30 03:28:59.500331 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.500157    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\" (UniqueName: \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\") pod \"7961eeb3-1510-49bc-83e6-aeadd7625f91\" (UID: \"7961eeb3-1510-49bc-83e6-aeadd7625f91\") "
Oct 30 03:28:59.502325 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.502291    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs" pod "7961eeb3-1510-49bc-83e6-aeadd7625f91" (UID: "7961eeb3-1510-49bc-83e6-aeadd7625f91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:28:59.502449 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.502355    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5" pod "7961eeb3-1510-49bc-83e6-aeadd7625f91" (UID: "7961eeb3-1510-49bc-83e6-aeadd7625f91"). InnerVolumeSpecName "kube-api-access-rkxf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:28:59.601468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.601398    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkxf5\" (UniqueName: \"kubernetes.io/projected/7961eeb3-1510-49bc-83e6-aeadd7625f91-kube-api-access-rkxf5\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:59.601468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:28:59.601426    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7961eeb3-1510-49bc-83e6-aeadd7625f91-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:00.157160 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.157126    4869 generic.go:356] "Generic (PLEG): container finished" podID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerID="24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b" exitCode=0
Oct 30 03:29:00.157561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.157169    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"
Oct 30 03:29:00.157561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.157169    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" event={"ID":"7961eeb3-1510-49bc-83e6-aeadd7625f91","Type":"ContainerDied","Data":"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"}
Oct 30 03:29:00.157561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.157302    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62" event={"ID":"7961eeb3-1510-49bc-83e6-aeadd7625f91","Type":"ContainerDied","Data":"ae7541a26e80283cd0ce264334e0b2f1844f382a842f59d1b0d7721902cb65c4"}
Oct 30 03:29:00.157561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.157342    4869 scope.go:122] "RemoveContainer" containerID="24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"
Oct 30 03:29:00.169482 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.169458    4869 scope.go:122] "RemoveContainer" containerID="24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"
Oct 30 03:29:00.169998 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:29:00.169976    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b\": container with ID starting with 24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b not found: ID does not exist" containerID="24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"
Oct 30 03:29:00.170070 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.170010    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b"} err="failed to get container status \"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b\": rpc error: code = NotFound desc = could not find container \"24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b\": container with ID starting with 24d223bc192442bc3bbcc707d3240191a043a9bbb8a71ac57646d8e58ff38f5b not found: ID does not exist"
Oct 30 03:29:00.207180 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.207157    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:29:00.218814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.218793    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-674b8746cc-bnz62"]
Oct 30 03:29:00.819371 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:00.819340    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" path="/var/lib/kubelet/pods/7961eeb3-1510-49bc-83e6-aeadd7625f91/volumes"
Oct 30 03:29:06.975452 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.975417    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:29:06.976019 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.975999    4869 cpu_manager.go:414] "containerMap: removing container" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main"
Oct 30 03:29:06.976102 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.976021    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main"
Oct 30 03:29:06.976187 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.976175    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="7961eeb3-1510-49bc-83e6-aeadd7625f91" containerName="main"
Oct 30 03:29:06.980805 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.980783    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:06.996462 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:06.996430    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"openshift-service-ca.crt\""
Oct 30 03:29:07.008194 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.008160    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"kube-root-ca.crt\""
Oct 30 03:29:07.008194 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.008189    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-kserve-self-signed-certs\""
Oct 30 03:29:07.008378 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.008259    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"default-dockercfg-tvbss\""
Oct 30 03:29:07.008378 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.008306    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-epp-sa-dockercfg-kc22n\""
Oct 30 03:29:07.010432 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.010404    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:29:07.059608 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.059562    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.059722 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.059634    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rf99\" (UniqueName: \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.161102 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.161068    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.161226 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.161110    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rf99\" (UniqueName: \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.163552 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.163530    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.183745 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.183716    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rf99\" (UniqueName: \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\") pod \"auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.294831 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.294741    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:07.598697 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:07.598668    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:29:07.600403 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:29:07.600377    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c66203_0fca_44bd_83d0_241e01ca664f.slice/crio-905eeb6df833dad8d89171e28abdf824a5707348f9179599275952414a50b31b WatchSource:0}: Error finding container 905eeb6df833dad8d89171e28abdf824a5707348f9179599275952414a50b31b: Status 404 returned error can't find the container with id 905eeb6df833dad8d89171e28abdf824a5707348f9179599275952414a50b31b
Oct 30 03:29:08.207283 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:08.207233    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" event={"ID":"28c66203-0fca-44bd-83d0-241e01ca664f","Type":"ContainerStarted","Data":"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"}
Oct 30 03:29:08.207821 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:08.207349    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" event={"ID":"28c66203-0fca-44bd-83d0-241e01ca664f","Type":"ContainerStarted","Data":"905eeb6df833dad8d89171e28abdf824a5707348f9179599275952414a50b31b"}
Oct 30 03:29:08.208511 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:08.208482    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:08.253854 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:08.253798    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podStartSLOduration=2.253783095 podStartE2EDuration="2.253783095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:29:08.252346221 +0000 UTC m=+2017.573925941" watchObservedRunningTime="2026-10-30 03:29:08.253783095 +0000 UTC m=+2017.575362814"
Oct 30 03:29:23.236203 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:23.236168    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:29:27.820531 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:29:27.820488    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:29:28.782065 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:28.782029    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:29:38.256274 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:38.256233    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main" containerID="cri-o://b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f" gracePeriod=45
Oct 30 03:29:38.781707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:38.781667    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:29:40.221930 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:40.221900    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:29:48.782174 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:48.782131    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:29:48.782703 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:48.782252    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:29:57.819228 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:29:57.819188    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:29:58.782336 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:29:58.782289    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:30:08.506136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.506107    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:30:08.537121 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.537064    4869 generic.go:356] "Generic (PLEG): container finished" podID="99085779-a787-4a41-8bbe-53e6fc48020c" containerID="b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f" exitCode=0
Oct 30 03:30:08.537121 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.537105    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"
Oct 30 03:30:08.537261 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.537148    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" event={"ID":"99085779-a787-4a41-8bbe-53e6fc48020c","Type":"ContainerDied","Data":"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"}
Oct 30 03:30:08.537261 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.537202    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq" event={"ID":"99085779-a787-4a41-8bbe-53e6fc48020c","Type":"ContainerDied","Data":"ae9179bc061cbe6df074d36d2ac116ed4e7a52296ef4797fec72da9394b3da81"}
Oct 30 03:30:08.537261 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.537228    4869 scope.go:122] "RemoveContainer" containerID="b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"
Oct 30 03:30:08.545829 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.545812    4869 scope.go:122] "RemoveContainer" containerID="b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"
Oct 30 03:30:08.546166 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:30:08.546102    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f\": container with ID starting with b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f not found: ID does not exist" containerID="b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"
Oct 30 03:30:08.546279 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.546195    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f"} err="failed to get container status \"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f\": rpc error: code = NotFound desc = could not find container \"b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f\": container with ID starting with b15bb3e01426077b40627203609d8f8c8c59b80a03ba5b973c61d9bf4566999f not found: ID does not exist"
Oct 30 03:30:08.656486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.656461    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\" (UniqueName: \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\") pod \"99085779-a787-4a41-8bbe-53e6fc48020c\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") "
Oct 30 03:30:08.656651 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.656512    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\" (UniqueName: \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\") pod \"99085779-a787-4a41-8bbe-53e6fc48020c\" (UID: \"99085779-a787-4a41-8bbe-53e6fc48020c\") "
Oct 30 03:30:08.658707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.658682    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs" pod "99085779-a787-4a41-8bbe-53e6fc48020c" (UID: "99085779-a787-4a41-8bbe-53e6fc48020c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:30:08.658819 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.658729    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4" pod "99085779-a787-4a41-8bbe-53e6fc48020c" (UID: "99085779-a787-4a41-8bbe-53e6fc48020c"). InnerVolumeSpecName "kube-api-access-ccxs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:30:08.757505 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.757480    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccxs4\" (UniqueName: \"kubernetes.io/projected/99085779-a787-4a41-8bbe-53e6fc48020c-kube-api-access-ccxs4\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:30:08.757505 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.757503    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99085779-a787-4a41-8bbe-53e6fc48020c-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:30:08.875073 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.875048    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:30:08.886646 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:08.886622    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-69vldwq"]
Oct 30 03:30:10.819354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:10.819317    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" path="/var/lib/kubelet/pods/99085779-a787-4a41-8bbe-53e6fc48020c/volumes"
Oct 30 03:30:27.820200 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:30:27.820163    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:30:31.032328 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:31.032291    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:30:31.041016 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:30:31.040992    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:30:57.822288 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:30:57.822252    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:31:09.253832 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:09.253791    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:31:10.221561 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:10.221518    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:31:15.709311 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:15.709274    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:31:15.709746 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:15.709459    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy" containerID="cri-o://b0741278fa5fc9b587f1ec014a17160649c1d4a45e3a43e0cdef00267856183a" gracePeriod=30
Oct 30 03:31:20.221483 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:20.221435    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:31:20.911647 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:20.911614    4869 generic.go:356] "Generic (PLEG): container finished" podID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerID="b0741278fa5fc9b587f1ec014a17160649c1d4a45e3a43e0cdef00267856183a" exitCode=0
Oct 30 03:31:20.911795 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:20.911689    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" event={"ID":"4c2ffb4a-3998-467a-ade4-9a646c270553","Type":"ContainerDied","Data":"b0741278fa5fc9b587f1ec014a17160649c1d4a45e3a43e0cdef00267856183a"}
Oct 30 03:31:20.955240 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:20.955217    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:31:21.100439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100357    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100395    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100693 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100444    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100693 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100462    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100693 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100510    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100693 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100625    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100693 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100685    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100742    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100770    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\") pod \"4c2ffb4a-3998-467a-ade4-9a646c270553\" (UID: \"4c2ffb4a-3998-467a-ade4-9a646c270553\") "
Oct 30 03:31:21.100956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100822    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:31:21.100956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100848    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:31:21.100956 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.100859    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101027    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101145    4869 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-credential-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101166    4869 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101180    4869 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-data\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101175    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:21.101277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.101194    4869 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-workload-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.102638 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.102611    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:31:21.102785 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.102770    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "kube-api-access-6rhrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:21.102851 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.102836    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:21.102952 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.102930    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo" pod "4c2ffb4a-3998-467a-ade4-9a646c270553" (UID: "4c2ffb4a-3998-467a-ade4-9a646c270553"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 03:31:21.201639 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.201612    4869 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-envoy\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.201763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.201650    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rhrd\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-kube-api-access-6rhrd\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.201763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.201668    4869 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-podinfo\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.201763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.201683    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c2ffb4a-3998-467a-ade4-9a646c270553-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.201763 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.201696    4869 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c2ffb4a-3998-467a-ade4-9a646c270553-istiod-ca-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:21.919156 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.919122    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"
Oct 30 03:31:21.919156 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.919147    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96" event={"ID":"4c2ffb4a-3998-467a-ade4-9a646c270553","Type":"ContainerDied","Data":"79f6b5192d34335a494299738cd1841208a3fe3560e69167d18ec890f07ff88f"}
Oct 30 03:31:21.919646 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.919204    4869 scope.go:122] "RemoveContainer" containerID="b0741278fa5fc9b587f1ec014a17160649c1d4a45e3a43e0cdef00267856183a"
Oct 30 03:31:21.981114 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.981084    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:31:21.992624 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:21.992593    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-2jh96"]
Oct 30 03:31:22.819873 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:22.819840    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" path="/var/lib/kubelet/pods/4c2ffb4a-3998-467a-ade4-9a646c270553/volumes"
Oct 30 03:31:24.280095 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:24.280036    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" containerID="cri-o://f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35" gracePeriod=45
Oct 30 03:31:27.819819 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:31:27.819787    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:31:30.221864 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:30.221818    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:31:30.222352 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:30.221949    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:31:40.221266 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:40.221229    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:31:50.221670 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:50.221627    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:31:54.536980 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.536949    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:31:54.657720 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.657690    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\" (UniqueName: \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\") pod \"28c66203-0fca-44bd-83d0-241e01ca664f\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") "
Oct 30 03:31:54.657867 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.657754    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\" (UniqueName: \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\") pod \"28c66203-0fca-44bd-83d0-241e01ca664f\" (UID: \"28c66203-0fca-44bd-83d0-241e01ca664f\") "
Oct 30 03:31:54.659845 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.659815    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs" pod "28c66203-0fca-44bd-83d0-241e01ca664f" (UID: "28c66203-0fca-44bd-83d0-241e01ca664f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:54.660098 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.660067    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99" pod "28c66203-0fca-44bd-83d0-241e01ca664f" (UID: "28c66203-0fca-44bd-83d0-241e01ca664f"). InnerVolumeSpecName "kube-api-access-7rf99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:54.759178 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.759117    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c66203-0fca-44bd-83d0-241e01ca664f-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:54.759178 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:54.759144    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rf99\" (UniqueName: \"kubernetes.io/projected/28c66203-0fca-44bd-83d0-241e01ca664f-kube-api-access-7rf99\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:55.092159 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.092075    4869 generic.go:356] "Generic (PLEG): container finished" podID="28c66203-0fca-44bd-83d0-241e01ca664f" containerID="f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35" exitCode=0
Oct 30 03:31:55.092159 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.092117    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"
Oct 30 03:31:55.092159 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.092126    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" event={"ID":"28c66203-0fca-44bd-83d0-241e01ca664f","Type":"ContainerDied","Data":"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"}
Oct 30 03:31:55.092390 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.092165    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92" event={"ID":"28c66203-0fca-44bd-83d0-241e01ca664f","Type":"ContainerDied","Data":"905eeb6df833dad8d89171e28abdf824a5707348f9179599275952414a50b31b"}
Oct 30 03:31:55.092390 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.092186    4869 scope.go:122] "RemoveContainer" containerID="f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"
Oct 30 03:31:55.101173 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.101147    4869 scope.go:122] "RemoveContainer" containerID="f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"
Oct 30 03:31:55.101458 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:31:55.101437    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35\": container with ID starting with f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35 not found: ID does not exist" containerID="f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"
Oct 30 03:31:55.101518 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.101466    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35"} err="failed to get container status \"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35\": rpc error: code = NotFound desc = could not find container \"f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35\": container with ID starting with f997c223b12bab88477b8bf9e20064e28f41913881a15d9abe05021afab1dc35 not found: ID does not exist"
Oct 30 03:31:55.141649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.141628    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:31:55.153305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:55.153284    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-77676c6894sqj92"]
Oct 30 03:31:56.819459 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:31:56.819420    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" path="/var/lib/kubelet/pods/28c66203-0fca-44bd-83d0-241e01ca664f/volumes"
Oct 30 03:31:57.819675 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:31:57.819642    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:32:02.160089 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160056    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160441    4869 cpu_manager.go:414] "containerMap: removing container" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160453    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160467    4869 cpu_manager.go:414] "containerMap: removing container" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160472    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160480    4869 cpu_manager.go:414] "containerMap: removing container" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160484    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160544    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="99085779-a787-4a41-8bbe-53e6fc48020c" containerName="main"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160554    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c2ffb4a-3998-467a-ade4-9a646c270553" containerName="istio-proxy"
Oct 30 03:32:02.160672 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.160561    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="28c66203-0fca-44bd-83d0-241e01ca664f" containerName="main"
Oct 30 03:32:02.163943 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.163918    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.181214 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.181156    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-epp-sa-dockercfg-4ghkq\""
Oct 30 03:32:02.184372 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.184334    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:32:02.193226 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.193198    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-kserve-self-signed-certs\""
Oct 30 03:32:02.193405 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.193257    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"default-dockercfg-78jnx\""
Oct 30 03:32:02.193405 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.193260    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"kube-root-ca.crt\""
Oct 30 03:32:02.193605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.193353    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"openshift-service-ca.crt\""
Oct 30 03:32:02.308377 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.308339    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg89b\" (UniqueName: \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.308377 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.308383    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.409645 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.409603    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg89b\" (UniqueName: \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.409796 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.409658    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.412293 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.412226    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.436730 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.436697    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg89b\" (UniqueName: \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\") pod \"auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.479139 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.479114    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:02.783836 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:02.783808    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:32:02.785640 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:32:02.785608    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a31c21_4304_4be1_a47e_797ead75b135.slice/crio-d0d32090be20ecc83eb5c4c1e08151e8f2145c1b45c178ab5c59ffb57b01496d WatchSource:0}: Error finding container d0d32090be20ecc83eb5c4c1e08151e8f2145c1b45c178ab5c59ffb57b01496d: Status 404 returned error can't find the container with id d0d32090be20ecc83eb5c4c1e08151e8f2145c1b45c178ab5c59ffb57b01496d
Oct 30 03:32:03.136370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:03.136285    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" event={"ID":"34a31c21-4304-4be1-a47e-797ead75b135","Type":"ContainerStarted","Data":"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"}
Oct 30 03:32:03.136370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:03.136340    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" event={"ID":"34a31c21-4304-4be1-a47e-797ead75b135","Type":"ContainerStarted","Data":"d0d32090be20ecc83eb5c4c1e08151e8f2145c1b45c178ab5c59ffb57b01496d"}
Oct 30 03:32:03.136370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:03.136362    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:03.176285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:03.176241    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podStartSLOduration=1.176226679 podStartE2EDuration="1.176226679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:32:03.175790453 +0000 UTC m=+2192.497370174" watchObservedRunningTime="2026-10-30 03:32:03.176226679 +0000 UTC m=+2192.497806398"
Oct 30 03:32:12.481344 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:32:12.481312    4869 logging.go:55] [core] [Channel #528 SubChannel #529]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.63:9003", ServerName: "10.132.0.63:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.63:9003: connect: connection refused"
Oct 30 03:32:13.480773 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:13.480697    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.63:9003\" within 1s: context deadline exceeded"
Oct 30 03:32:27.819678 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:32:27.819640    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:32:34.143043 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:32:34.143010    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:32:57.820850 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:32:57.820813    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:33:27.820730 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:33:27.820689    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:33:57.820464 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:33:57.820428    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:34:08.010434 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:08.010397    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:34:14.143165 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:14.143126    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:34:23.030965 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:23.030927    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" containerID="cri-o://f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853" gracePeriod=45
Oct 30 03:34:24.142634 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:24.142595    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:34:27.820316 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:34:27.820277    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:34:34.143087 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:34.143047    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:34:34.143639 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:34.143162    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:34:44.142882 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:44.142840    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:34:46.310920 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:46.310883    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:34:46.311395 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:46.311139    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" containerID="cri-o://a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e" gracePeriod=30
Oct 30 03:34:51.083480 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.083443    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 03:34:51.083894 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.083506    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:34:51.568397 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.568369    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:34:51.691790 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691761    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.691928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691823    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.691928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691862    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.691928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691895    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.691928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691912    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.692136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691959    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.692136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.691998    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.692136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692040    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.692136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692077    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\") pod \"55647964-88d3-4b0a-bcde-459b13687e66\" (UID: \"55647964-88d3-4b0a-bcde-459b13687e66\") "
Oct 30 03:34:51.692136 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692084    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:34:51.692401 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692323    4869 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.692401 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692333    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:34:51.692510 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692403    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:34:51.692608 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692552    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:34:51.692692 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.692569    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:34:51.694091 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.694049    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:34:51.694205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.694110    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:34:51.694205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.694182    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 03:34:51.694348 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.694329    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j" pod "55647964-88d3-4b0a-bcde-459b13687e66" (UID: "55647964-88d3-4b0a-bcde-459b13687e66"). InnerVolumeSpecName "kube-api-access-htx4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:34:51.793707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793674    4869 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55647964-88d3-4b0a-bcde-459b13687e66-istio-podinfo\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793709    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793724    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htx4j\" (UniqueName: \"kubernetes.io/projected/55647964-88d3-4b0a-bcde-459b13687e66-kube-api-access-htx4j\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793740    4869 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55647964-88d3-4b0a-bcde-459b13687e66-istiod-ca-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793753    4869 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-workload-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793766    4869 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-credential-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793778    4869 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-data\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:51.793868 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:51.793794    4869 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55647964-88d3-4b0a-bcde-459b13687e66-istio-envoy\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:52.034853 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.034772    4869 generic.go:356] "Generic (PLEG): container finished" podID="55647964-88d3-4b0a-bcde-459b13687e66" containerID="a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e" exitCode=0
Oct 30 03:34:52.034853 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.034826    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"
Oct 30 03:34:52.035018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.034863    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" event={"ID":"55647964-88d3-4b0a-bcde-459b13687e66","Type":"ContainerDied","Data":"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"}
Oct 30 03:34:52.035018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.034915    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn" event={"ID":"55647964-88d3-4b0a-bcde-459b13687e66","Type":"ContainerDied","Data":"51823deffc3cedcb5adc7baf2db82580692052c3a17902e778a6989c06473a96"}
Oct 30 03:34:52.035018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.034936    4869 scope.go:122] "RemoveContainer" containerID="a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"
Oct 30 03:34:52.044988 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.044968    4869 scope.go:122] "RemoveContainer" containerID="a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"
Oct 30 03:34:52.045261 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:34:52.045239    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e\": container with ID starting with a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e not found: ID does not exist" containerID="a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"
Oct 30 03:34:52.045308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.045270    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e"} err="failed to get container status \"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e\": rpc error: code = NotFound desc = could not find container \"a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e\": container with ID starting with a501375fa3fc3a97060d476bdb3de76e2f06713bbdf7064fcf198e936f36a31e not found: ID does not exist"
Oct 30 03:34:52.085498 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.085472    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:34:52.097036 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.097014    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-464gn"]
Oct 30 03:34:52.819657 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:52.819605    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55647964-88d3-4b0a-bcde-459b13687e66" path="/var/lib/kubelet/pods/55647964-88d3-4b0a-bcde-459b13687e66/volumes"
Oct 30 03:34:53.287886 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.287863    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:34:53.406706 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.406644    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\" (UniqueName: \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\") pod \"34a31c21-4304-4be1-a47e-797ead75b135\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") "
Oct 30 03:34:53.406840 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.406704    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\" (UniqueName: \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\") pod \"34a31c21-4304-4be1-a47e-797ead75b135\" (UID: \"34a31c21-4304-4be1-a47e-797ead75b135\") "
Oct 30 03:34:53.408761 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.408734    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs" pod "34a31c21-4304-4be1-a47e-797ead75b135" (UID: "34a31c21-4304-4be1-a47e-797ead75b135"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:34:53.408861 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.408812    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b" pod "34a31c21-4304-4be1-a47e-797ead75b135" (UID: "34a31c21-4304-4be1-a47e-797ead75b135"). InnerVolumeSpecName "kube-api-access-tg89b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:34:53.507394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.507370    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34a31c21-4304-4be1-a47e-797ead75b135-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:53.507394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:53.507394    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg89b\" (UniqueName: \"kubernetes.io/projected/34a31c21-4304-4be1-a47e-797ead75b135-kube-api-access-tg89b\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:34:54.047789 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.047751    4869 generic.go:356] "Generic (PLEG): container finished" podID="34a31c21-4304-4be1-a47e-797ead75b135" containerID="f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853" exitCode=0
Oct 30 03:34:54.047951 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.047797    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" event={"ID":"34a31c21-4304-4be1-a47e-797ead75b135","Type":"ContainerDied","Data":"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"}
Oct 30 03:34:54.047951 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.047846    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4" event={"ID":"34a31c21-4304-4be1-a47e-797ead75b135","Type":"ContainerDied","Data":"d0d32090be20ecc83eb5c4c1e08151e8f2145c1b45c178ab5c59ffb57b01496d"}
Oct 30 03:34:54.047951 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.047870    4869 scope.go:122] "RemoveContainer" containerID="f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"
Oct 30 03:34:54.047951 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.047802    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"
Oct 30 03:34:54.057322 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.057305    4869 scope.go:122] "RemoveContainer" containerID="f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"
Oct 30 03:34:54.057613 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:34:54.057589    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853\": container with ID starting with f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853 not found: ID does not exist" containerID="f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"
Oct 30 03:34:54.057724 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.057623    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853"} err="failed to get container status \"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853\": rpc error: code = NotFound desc = could not find container \"f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853\": container with ID starting with f0e2a312d5758741c84ee313d3a5703bf747cb1c992615603a7ced93a4710853 not found: ID does not exist"
Oct 30 03:34:54.098258 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.098234    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:34:54.109783 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.109761    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d987cbbfd-f6gz4"]
Oct 30 03:34:54.819714 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:54.819679    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34a31c21-4304-4be1-a47e-797ead75b135" path="/var/lib/kubelet/pods/34a31c21-4304-4be1-a47e-797ead75b135/volumes"
Oct 30 03:34:56.130022 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.129988    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:34:56.130500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130390    4869 cpu_manager.go:414] "containerMap: removing container" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main"
Oct 30 03:34:56.130500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130404    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main"
Oct 30 03:34:56.130500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130417    4869 cpu_manager.go:414] "containerMap: removing container" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy"
Oct 30 03:34:56.130500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130424    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy"
Oct 30 03:34:56.130732 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130532    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="34a31c21-4304-4be1-a47e-797ead75b135" containerName="main"
Oct 30 03:34:56.130732 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.130542    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="55647964-88d3-4b0a-bcde-459b13687e66" containerName="istio-proxy"
Oct 30 03:34:56.135281 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.135255    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.162907 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.162842    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"kube-root-ca.crt\""
Oct 30 03:34:56.162907 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.162866    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"openshift-service-ca.crt\""
Oct 30 03:34:56.163093 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.162946    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"default-dockercfg-tplmt\""
Oct 30 03:34:56.163093 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.163008    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-kserve-self-signed-certs\""
Oct 30 03:34:56.163093 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.163028    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-epp-sa-dockercfg-plrxv\""
Oct 30 03:34:56.164957 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.164936    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:34:56.329613 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.329560    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97xx\" (UniqueName: \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.329773 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.329682    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.430887 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.430803    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97xx\" (UniqueName: \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.431052 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.430894    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.440541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.440508    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.456810 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.456771    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97xx\" (UniqueName: \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\") pod \"tokenizer-migration-path-test-kserve-router-scheduler-566628k87\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:56.751851 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:56.751810    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:57.050376 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:57.050349    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:34:57.052062 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:34:57.052033    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fe577b_f05f_4a86_bd02_c9e2ac224937.slice/crio-44f8f7c3da8ff791b40a636f0f8b697e9d0eac90d4a9ea436eaec657ebebbf35 WatchSource:0}: Error finding container 44f8f7c3da8ff791b40a636f0f8b697e9d0eac90d4a9ea436eaec657ebebbf35: Status 404 returned error can't find the container with id 44f8f7c3da8ff791b40a636f0f8b697e9d0eac90d4a9ea436eaec657ebebbf35
Oct 30 03:34:57.069535 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:57.069510    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" event={"ID":"42fe577b-f05f-4a86-bd02-c9e2ac224937","Type":"ContainerStarted","Data":"44f8f7c3da8ff791b40a636f0f8b697e9d0eac90d4a9ea436eaec657ebebbf35"}
Oct 30 03:34:57.828823 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:34:57.828788    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:34:58.108810 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:58.108708    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" event={"ID":"42fe577b-f05f-4a86-bd02-c9e2ac224937","Type":"ContainerStarted","Data":"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"}
Oct 30 03:34:58.109001 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:58.108874    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:34:58.151260 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:34:58.151193    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podStartSLOduration=2.1511764859999998 podStartE2EDuration="2.151176486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:34:58.150075053 +0000 UTC m=+2367.471654773" watchObservedRunningTime="2026-10-30 03:34:58.151176486 +0000 UTC m=+2367.472756241"
Oct 30 03:35:27.822796 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:35:27.822699    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:35:29.115690 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:29.115654    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:35:31.068897 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.068864    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:35:31.079727 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.079706    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:35:31.471687 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.471650    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:35:31.476977 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.476953    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.509410 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.509387    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:35:31.512527 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.512500    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:35:31.517018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.516996    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.529057 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.529028    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:35:31.532992 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.532970    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533011    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533067    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533098    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533125    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533160    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533208    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdn9l\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533252    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.533354 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.533281    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.634692 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634660    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.634870 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634703    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.634870 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634788    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.634870 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634833    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635034 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634895    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635034 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634920    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635034 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.634962    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635069    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdn9l\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635088    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635118    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635151    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635180    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635219    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635289    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635353    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635390    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635415    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjlt\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635477    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635641    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.635707 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635697    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.636023 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635716    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.636023 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.635771    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.636228 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.636201    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.637370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.637330    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.637518 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.637498    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.657084 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.657061    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.657351 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.657334    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdn9l\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.736769 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736704    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.736769 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736748    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.736924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736777    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.736924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736824    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjlt\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.736924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736858    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.736924 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736892    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737168 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736936    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737168 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736962    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737168 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.736987    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737345 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.737234    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737663 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.737640    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737788 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.737769    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737866 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.737839    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.737972 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.737953    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.738925 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.738899    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.739190 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.739173    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.759404 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.759378    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.759720 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.759702    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjlt\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:31.790654 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.790632    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:31.839173 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:31.839134    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:32.103473 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.103448    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:35:32.104737 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:35:32.104710    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886df68e_ee3a_4523_aca1_1e60b6c57f86.slice/crio-9c58d9fd437a0de43ab18dc6083ef839515fa3546cbf3d13e4277bd1cb958a48 WatchSource:0}: Error finding container 9c58d9fd437a0de43ab18dc6083ef839515fa3546cbf3d13e4277bd1cb958a48: Status 404 returned error can't find the container with id 9c58d9fd437a0de43ab18dc6083ef839515fa3546cbf3d13e4277bd1cb958a48
Oct 30 03:35:32.106931 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.106896    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.107004 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.106960    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.107004 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.106991    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.150942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.150915    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:35:32.151831 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:35:32.151806    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe994ad2_5ec5_42fa_9141_138de3932f76.slice/crio-b00a9debaea8160c8147dc0eb36a9222d96de3d7bc8f36f89bbc6163d9e5af9d WatchSource:0}: Error finding container b00a9debaea8160c8147dc0eb36a9222d96de3d7bc8f36f89bbc6163d9e5af9d: Status 404 returned error can't find the container with id b00a9debaea8160c8147dc0eb36a9222d96de3d7bc8f36f89bbc6163d9e5af9d
Oct 30 03:35:32.154146 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.154118    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.154206 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.154177    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.154247 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.154207    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 03:35:32.291599 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.290672    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" event={"ID":"be994ad2-5ec5-42fa-9141-138de3932f76","Type":"ContainerStarted","Data":"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"}
Oct 30 03:35:32.291599 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.290735    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" event={"ID":"be994ad2-5ec5-42fa-9141-138de3932f76","Type":"ContainerStarted","Data":"b00a9debaea8160c8147dc0eb36a9222d96de3d7bc8f36f89bbc6163d9e5af9d"}
Oct 30 03:35:32.292507 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.292478    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" event={"ID":"886df68e-ee3a-4523-aca1-1e60b6c57f86","Type":"ContainerStarted","Data":"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"}
Oct 30 03:35:32.292650 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.292525    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" event={"ID":"886df68e-ee3a-4523-aca1-1e60b6c57f86","Type":"ContainerStarted","Data":"9c58d9fd437a0de43ab18dc6083ef839515fa3546cbf3d13e4277bd1cb958a48"}
Oct 30 03:35:32.380529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.380425    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podStartSLOduration=1.3804071470000001 podStartE2EDuration="1.380407147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:35:32.379708001 +0000 UTC m=+2401.701287744" watchObservedRunningTime="2026-10-30 03:35:32.380407147 +0000 UTC m=+2401.701986866"
Oct 30 03:35:32.381325 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.381284    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podStartSLOduration=1.381274818 podStartE2EDuration="1.381274818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:35:32.335766968 +0000 UTC m=+2401.657346688" watchObservedRunningTime="2026-10-30 03:35:32.381274818 +0000 UTC m=+2401.702854537"
Oct 30 03:35:32.793603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.792691    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:32.839464 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:32.839435    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:33.794603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:33.793663    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 03:35:33.794603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:33.793722    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 03:35:33.840840 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:33.840805    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 03:35:33.840993 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:33.840858    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 03:35:34.034688 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:34.034645    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:35:34.803603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:34.792051    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 03:35:34.803603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:34.792128    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 03:35:34.840200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:34.840166    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 03:35:34.840360 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:34.840217    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 03:35:35.796605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:35.793930    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 03:35:35.796605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:35.794006    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 03:35:35.839928 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:35.839891    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 03:35:35.840412 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:35.840377    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 03:35:36.796017 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:36.795977    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 03:35:36.796319 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:36.796287    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 03:35:36.840082 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:36.840053    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 03:35:36.840499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:36.840471    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 03:35:37.792601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:37.791959    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 03:35:37.792601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:37.792026    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 03:35:37.839998 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:37.839952    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 03:35:37.840165 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:37.840012    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 03:35:38.795289 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.795256    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:38.795637 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.795606    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:38.796282 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.796260    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:35:38.843160 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.843133    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:38.843556 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.843394    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:38.844072 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:38.844054    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:35:39.115616 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:39.115513    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:35:49.057808 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:49.057753    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" containerID="cri-o://390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec" gracePeriod=45
Oct 30 03:35:49.115362 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:49.115328    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:35:57.820033 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:35:57.819992    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:35:59.115620 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:59.115535    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:35:59.116064 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:35:59.115709    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:36:09.115733 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:09.115687    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:36:19.114409 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:36:19.114382    4869 logging.go:55] [core] [Channel #632 SubChannel #633]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.64:9003", ServerName: "10.132.0.64:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.64:9003: connect: connection refused"
Oct 30 03:36:19.313516 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.313490    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:36:19.356979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.356911    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\" (UniqueName: \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\") pod \"42fe577b-f05f-4a86-bd02-c9e2ac224937\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") "
Oct 30 03:36:19.356979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.356974    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\" (UniqueName: \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\") pod \"42fe577b-f05f-4a86-bd02-c9e2ac224937\" (UID: \"42fe577b-f05f-4a86-bd02-c9e2ac224937\") "
Oct 30 03:36:19.359369 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.359333    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx" pod "42fe577b-f05f-4a86-bd02-c9e2ac224937" (UID: "42fe577b-f05f-4a86-bd02-c9e2ac224937"). InnerVolumeSpecName "kube-api-access-x97xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:19.359476 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.359341    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs" pod "42fe577b-f05f-4a86-bd02-c9e2ac224937" (UID: "42fe577b-f05f-4a86-bd02-c9e2ac224937"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:36:19.458541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.458515    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42fe577b-f05f-4a86-bd02-c9e2ac224937-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:19.458541 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.458539    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x97xx\" (UniqueName: \"kubernetes.io/projected/42fe577b-f05f-4a86-bd02-c9e2ac224937-kube-api-access-x97xx\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:19.560698 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.560669    4869 generic.go:356] "Generic (PLEG): container finished" podID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerID="390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec" exitCode=0
Oct 30 03:36:19.560799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.560707    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" event={"ID":"42fe577b-f05f-4a86-bd02-c9e2ac224937","Type":"ContainerDied","Data":"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"}
Oct 30 03:36:19.560799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.560723    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"
Oct 30 03:36:19.560799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.560758    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" event={"ID":"42fe577b-f05f-4a86-bd02-c9e2ac224937","Type":"ContainerDied","Data":"44f8f7c3da8ff791b40a636f0f8b697e9d0eac90d4a9ea436eaec657ebebbf35"}
Oct 30 03:36:19.560799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.560787    4869 scope.go:122] "RemoveContainer" containerID="390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"
Oct 30 03:36:19.573080 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.572996    4869 scope.go:122] "RemoveContainer" containerID="390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"
Oct 30 03:36:19.573481 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:36:19.573402    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec\": container with ID starting with 390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec not found: ID does not exist" containerID="390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"
Oct 30 03:36:19.573481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.573446    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec"} err="failed to get container status \"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec\": rpc error: code = NotFound desc = could not find container \"390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec\": container with ID starting with 390a9c8a23b2e2d8c394d0cd683710630ab3478ecd32717bd8bbfd3b20a52dec not found: ID does not exist"
Oct 30 03:36:19.611455 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.611400    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:36:19.615060 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:19.615042    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87"]
Oct 30 03:36:20.114903 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:20.114864    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-router-scheduler-566628k87" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.64:9003\" within 1s: context deadline exceeded"
Oct 30 03:36:20.115245 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:36:20.114957    4869 logging.go:55] [core] [Channel #632 SubChannel #633]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.64:9003", ServerName: "10.132.0.64:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.64:9003: operation was canceled"
Oct 30 03:36:20.820194 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:36:20.820149    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" path="/var/lib/kubelet/pods/42fe577b-f05f-4a86-bd02-c9e2ac224937/volumes"
Oct 30 03:36:27.819243 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:36:27.819208    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:36:57.819143 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:36:57.819108    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:37:27.820302 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:37:27.820263    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:37:44.920439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.920406    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:37:44.920937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.920908    4869 cpu_manager.go:414] "containerMap: removing container" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main"
Oct 30 03:37:44.920937 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.920925    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main"
Oct 30 03:37:44.921046 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.921032    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="42fe577b-f05f-4a86-bd02-c9e2ac224937" containerName="main"
Oct 30 03:37:44.924248 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.924220    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:44.944285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.944253    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:37:44.952619 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.952596    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\""
Oct 30 03:37:44.952619 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.952599    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\""
Oct 30 03:37:44.952801 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.952661    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\""
Oct 30 03:37:44.952801 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.952763    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-hm8vv\""
Oct 30 03:37:44.952881 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:44.952795    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-4bz6w\""
Oct 30 03:37:45.008150 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.008113    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49nm\" (UniqueName: \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.008320 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.008160    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.108820 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.108777    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49nm\" (UniqueName: \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.108998 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.108856    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.112847 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.112812    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.133282 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.133251    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49nm\" (UniqueName: \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\") pod \"tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.237657 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.237622    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:45.544694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:45.544668    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:37:45.546436 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:37:45.546409    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983dfd5f_113e_43d7_9454_fb0b2aa07147.slice/crio-2917b782655cd9851c42709b0697cefacd689fd007a9f3c82c167f79b7ce4de1 WatchSource:0}: Error finding container 2917b782655cd9851c42709b0697cefacd689fd007a9f3c82c167f79b7ce4de1: Status 404 returned error can't find the container with id 2917b782655cd9851c42709b0697cefacd689fd007a9f3c82c167f79b7ce4de1
Oct 30 03:37:46.012058 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:46.012025    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerStarted","Data":"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"}
Oct 30 03:37:46.012430 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:46.012075    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerStarted","Data":"2917b782655cd9851c42709b0697cefacd689fd007a9f3c82c167f79b7ce4de1"}
Oct 30 03:37:46.012430 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:46.012154    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:46.051997 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:46.051953    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podStartSLOduration=2.051939648 podStartE2EDuration="2.051939648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:46.050867068 +0000 UTC m=+2535.372446787" watchObservedRunningTime="2026-10-30 03:37:46.051939648 +0000 UTC m=+2535.373519367"
Oct 30 03:37:55.239945 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:37:55.239912    4869 logging.go:55] [core] [Channel #634 SubChannel #635]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.67:9003", ServerName: "10.132.0.67:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.67:9003: connect: connection refused"
Oct 30 03:37:56.093076 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:56.093001    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-0eb24714_tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf_983dfd5f-113e-43d7-9454-fb0b2aa07147/main/0.log"
Oct 30 03:37:56.093076 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:56.093039    4869 generic.go:356] "Generic (PLEG): container finished" podID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerID="86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6" exitCode=1
Oct 30 03:37:56.093289 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:56.093093    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerDied","Data":"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"}
Oct 30 03:37:56.093380 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:56.093365    4869 scope.go:122] "RemoveContainer" containerID="86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"
Oct 30 03:37:56.238875 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:56.238838    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.67:9003\" within 1s: context deadline exceeded"
Oct 30 03:37:57.100370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:57.100338    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-0eb24714_tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf_983dfd5f-113e-43d7-9454-fb0b2aa07147/main/0.log"
Oct 30 03:37:57.100863 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:57.100404    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerStarted","Data":"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"}
Oct 30 03:37:57.100863 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:37:57.100703    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:37:57.821267 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:37:57.821225    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:38:27.819870 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:38:27.819831    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:38:28.107303 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:28.107220    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:38:34.110614 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:34.110558    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:38:38.107029 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:38.106982    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:38:48.107439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:48.107399    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:38:49.130304 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:49.130261    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" containerID="cri-o://4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76" gracePeriod=45
Oct 30 03:38:57.819626 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:38:57.819565    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:38:58.106892 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:58.106812    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:38:58.107052 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:38:58.106928    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:39:08.107374 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:08.107324    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:39:18.107071 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:18.107023    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:39:19.386357 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.386335    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-0eb24714_tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf_983dfd5f-113e-43d7-9454-fb0b2aa07147/main/0.log"
Oct 30 03:39:19.388597 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.388544    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:39:19.494447 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.494423    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\" (UniqueName: \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\") pod \"983dfd5f-113e-43d7-9454-fb0b2aa07147\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") "
Oct 30 03:39:19.494598 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.494473    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\" (UniqueName: \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\") pod \"983dfd5f-113e-43d7-9454-fb0b2aa07147\" (UID: \"983dfd5f-113e-43d7-9454-fb0b2aa07147\") "
Oct 30 03:39:19.496525 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.496501    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs" pod "983dfd5f-113e-43d7-9454-fb0b2aa07147" (UID: "983dfd5f-113e-43d7-9454-fb0b2aa07147"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:39:19.496650 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.496522    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm" pod "983dfd5f-113e-43d7-9454-fb0b2aa07147" (UID: "983dfd5f-113e-43d7-9454-fb0b2aa07147"). InnerVolumeSpecName "kube-api-access-n49nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:39:19.536134 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536115    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-inference-service-0eb24714_tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf_983dfd5f-113e-43d7-9454-fb0b2aa07147/main/0.log"
Oct 30 03:39:19.536218 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536157    4869 generic.go:356] "Generic (PLEG): container finished" podID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerID="4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76" exitCode=0
Oct 30 03:39:19.536262 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536219    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"
Oct 30 03:39:19.536262 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536219    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerDied","Data":"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"}
Oct 30 03:39:19.536325 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536278    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf" event={"ID":"983dfd5f-113e-43d7-9454-fb0b2aa07147","Type":"ContainerDied","Data":"2917b782655cd9851c42709b0697cefacd689fd007a9f3c82c167f79b7ce4de1"}
Oct 30 03:39:19.536325 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.536305    4869 scope.go:122] "RemoveContainer" containerID="4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"
Oct 30 03:39:19.545015 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.544998    4869 scope.go:122] "RemoveContainer" containerID="86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"
Oct 30 03:39:19.552782 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.552758    4869 scope.go:122] "RemoveContainer" containerID="4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"
Oct 30 03:39:19.553035 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:39:19.553014    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76\": container with ID starting with 4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76 not found: ID does not exist" containerID="4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"
Oct 30 03:39:19.553090 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.553044    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76"} err="failed to get container status \"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76\": rpc error: code = NotFound desc = could not find container \"4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76\": container with ID starting with 4c2e90f77f62ce2f3851c433d2a064e1db6c9a89e44472e7dd2ca2a93e4c2b76 not found: ID does not exist"
Oct 30 03:39:19.553090 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.553062    4869 scope.go:122] "RemoveContainer" containerID="86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"
Oct 30 03:39:19.553276 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:39:19.553259    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6\": container with ID starting with 86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6 not found: ID does not exist" containerID="86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"
Oct 30 03:39:19.553322 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.553282    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6"} err="failed to get container status \"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6\": rpc error: code = NotFound desc = could not find container \"86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6\": container with ID starting with 86c8dc92121baa533387efb5ac71bd837f138202ae28a80f57cd7ba932e76ed6 not found: ID does not exist"
Oct 30 03:39:19.585914 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.585892    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:39:19.589699 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.589677    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-74bb652pxf"]
Oct 30 03:39:19.595288 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.595270    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983dfd5f-113e-43d7-9454-fb0b2aa07147-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:39:19.595356 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:19.595289    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49nm\" (UniqueName: \"kubernetes.io/projected/983dfd5f-113e-43d7-9454-fb0b2aa07147-kube-api-access-n49nm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:39:20.818588 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:20.818538    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" path="/var/lib/kubelet/pods/983dfd5f-113e-43d7-9454-fb0b2aa07147/volumes"
Oct 30 03:39:27.819964 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:39:27.819931    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:39:31.102200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.102167    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:39:31.102593 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.102566    4869 cpu_manager.go:414] "containerMap: removing container" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:39:31.102645 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.102593    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:39:31.102700 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.102690    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:39:31.102735 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.102704    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:39:31.105811 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.105790    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.125093 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.125060    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:39:31.133320 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.133299    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"kube-root-ca.crt\""
Oct 30 03:39:31.133473 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.133362    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"default-dockercfg-6rtrh\""
Oct 30 03:39:31.133473 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.133464    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Oct 30 03:39:31.133674 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.133385    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"openshift-service-ca.crt\""
Oct 30 03:39:31.133674 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.133546    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-350756ca\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-svccd\""
Oct 30 03:39:31.177666 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.177638    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.177793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.177710    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7wc\" (UniqueName: \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.279205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.279174    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.279370 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.279246    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7wc\" (UniqueName: \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.281746 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.281715    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.303836 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.303804    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7wc\" (UniqueName: \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") " pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.423368 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.423293    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:31.725183 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:31.725156    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:39:31.726935 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:39:31.726900    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661 WatchSource:0}: Error finding container f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661: Status 404 returned error can't find the container with id f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661
Oct 30 03:39:32.605838 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:32.605800    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" event={"ID":"2eac351f-f065-4d04-9a20-cb6a93fd9eef","Type":"ContainerStarted","Data":"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"}
Oct 30 03:39:32.606322 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:32.605854    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" event={"ID":"2eac351f-f065-4d04-9a20-cb6a93fd9eef","Type":"ContainerStarted","Data":"f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661"}
Oct 30 03:39:32.606322 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:32.605885    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:39:32.649014 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:39:32.648961    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podStartSLOduration=1.648944588 podStartE2EDuration="1.648944588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:32.648435574 +0000 UTC m=+2641.970015320" watchObservedRunningTime="2026-10-30 03:39:32.648944588 +0000 UTC m=+2641.970524307"
Oct 30 03:39:57.819315 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:39:57.819279    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:40:03.624932 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:03.624902    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:40:06.076708 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:06.076668    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:40:13.625637 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:13.625596    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:40:21.100489 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:21.100443    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main" containerID="cri-o://a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da" gracePeriod=45
Oct 30 03:40:23.625459 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:23.625418    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:40:27.820826 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:40:27.820784    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:40:31.106342 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:31.106312    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:40:31.116793 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:31.116766    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:40:33.625253 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:33.625213    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:40:33.625665 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:33.625317    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:40:43.625790 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:43.625752    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:40:51.222938 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:40:51.222897    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-conmon-a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:40:51.223321 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:40:51.222960    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-conmon-a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eac351f_f065_4d04_9a20_cb6a93fd9eef.slice/crio-a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:40:51.365063 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.365000    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:40:51.498476 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.498446    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\" (UniqueName: \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\") pod \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") "
Oct 30 03:40:51.498661 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.498563    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\" (UniqueName: \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\") pod \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\" (UID: \"2eac351f-f065-4d04-9a20-cb6a93fd9eef\") "
Oct 30 03:40:51.500630 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.500597    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs" pod "2eac351f-f065-4d04-9a20-cb6a93fd9eef" (UID: "2eac351f-f065-4d04-9a20-cb6a93fd9eef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:40:51.500630 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.500620    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc" pod "2eac351f-f065-4d04-9a20-cb6a93fd9eef" (UID: "2eac351f-f065-4d04-9a20-cb6a93fd9eef"). InnerVolumeSpecName "kube-api-access-pg7wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:51.599826 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.599801    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg7wc\" (UniqueName: \"kubernetes.io/projected/2eac351f-f065-4d04-9a20-cb6a93fd9eef-kube-api-access-pg7wc\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:51.599826 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:51.599822    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eac351f-f065-4d04-9a20-cb6a93fd9eef-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:52.067188 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.067151    4869 generic.go:356] "Generic (PLEG): container finished" podID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerID="a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da" exitCode=0
Oct 30 03:40:52.067347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.067191    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"
Oct 30 03:40:52.067347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.067193    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" event={"ID":"2eac351f-f065-4d04-9a20-cb6a93fd9eef","Type":"ContainerDied","Data":"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"}
Oct 30 03:40:52.067347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.067320    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b" event={"ID":"2eac351f-f065-4d04-9a20-cb6a93fd9eef","Type":"ContainerDied","Data":"f3d989e55385f8dec8eeeaff1d03b085746be7d850077ce77d6237759807d661"}
Oct 30 03:40:52.067347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.067347    4869 scope.go:122] "RemoveContainer" containerID="a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"
Oct 30 03:40:52.076929 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.076913    4869 scope.go:122] "RemoveContainer" containerID="a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"
Oct 30 03:40:52.077186 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:40:52.077167    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da\": container with ID starting with a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da not found: ID does not exist" containerID="a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"
Oct 30 03:40:52.077263 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.077193    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da"} err="failed to get container status \"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da\": rpc error: code = NotFound desc = could not find container \"a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da\": container with ID starting with a8028fbfa4846513cff67ad7f833eb92adb0aed9c0784b93902d18b6517b30da not found: ID does not exist"
Oct 30 03:40:52.117839 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.117819    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:40:52.129373 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.129336    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-350756ca/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheh864b"]
Oct 30 03:40:52.818548 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:40:52.818514    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" path="/var/lib/kubelet/pods/2eac351f-f065-4d04-9a20-cb6a93fd9eef/volumes"
Oct 30 03:40:57.819841 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:40:57.819800    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:41:01.531675 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.531623    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:41:01.532316 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.532292    4869 cpu_manager.go:414] "containerMap: removing container" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main"
Oct 30 03:41:01.532316 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.532316    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main"
Oct 30 03:41:01.532461 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.532346    4869 cpu_manager.go:414] "containerMap: removing container" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:41:01.532461 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.532352    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="983dfd5f-113e-43d7-9454-fb0b2aa07147" containerName="main"
Oct 30 03:41:01.532461 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.532411    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="2eac351f-f065-4d04-9a20-cb6a93fd9eef" containerName="main"
Oct 30 03:41:01.535889 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.535866    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.553288 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.553256    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:41:01.562148 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.562098    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-m24lk\""
Oct 30 03:41:01.562333 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.562163    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-stn6p\""
Oct 30 03:41:01.564553 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.564529    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\""
Oct 30 03:41:01.564702 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.564629    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\""
Oct 30 03:41:01.564770 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.564739    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Oct 30 03:41:01.673633 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.673558    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfj2\" (UniqueName: \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.673834 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.673724    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.774931 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.774883    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.775110 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.774977    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfj2\" (UniqueName: \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.777493 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.777461    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.797998 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.797933    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfj2\" (UniqueName: \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") " pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:01.856176 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:01.852448    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:02.156798 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:02.156768    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:41:02.158693 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:41:02.158661    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9df837d_016d_45b4_b8b9_44b5256efcb6.slice/crio-8e1beb1145d28b2e6e3ca113ef4b56f3208263d1b3696127bd6059c2fc71fa0d WatchSource:0}: Error finding container 8e1beb1145d28b2e6e3ca113ef4b56f3208263d1b3696127bd6059c2fc71fa0d: Status 404 returned error can't find the container with id 8e1beb1145d28b2e6e3ca113ef4b56f3208263d1b3696127bd6059c2fc71fa0d
Oct 30 03:41:03.133606 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:03.127114    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" event={"ID":"f9df837d-016d-45b4-b8b9-44b5256efcb6","Type":"ContainerStarted","Data":"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"}
Oct 30 03:41:03.133606 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:03.127189    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" event={"ID":"f9df837d-016d-45b4-b8b9-44b5256efcb6","Type":"ContainerStarted","Data":"8e1beb1145d28b2e6e3ca113ef4b56f3208263d1b3696127bd6059c2fc71fa0d"}
Oct 30 03:41:03.133606 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:03.128224    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:03.180836 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:03.179031    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podStartSLOduration=2.179007134 podStartE2EDuration="2.179007134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:41:03.167312595 +0000 UTC m=+2732.488892329" watchObservedRunningTime="2026-10-30 03:41:03.179007134 +0000 UTC m=+2732.500586876"
Oct 30 03:41:27.820360 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:41:27.820316    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:41:35.155656 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:35.155618    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:41:38.964159 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:38.964116    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:41:38.969894 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:38.969870    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:38.987620 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:38.987593    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:41:38.996462 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:38.996430    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Oct 30 03:41:38.996462 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:38.996391    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-fnfnx\""
Oct 30 03:41:39.060310 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.060282    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.060441 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.060328    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffj55\" (UniqueName: \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.161350 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.161316    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.161495 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.161363    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffj55\" (UniqueName: \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.163780 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.163758    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.184309 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.184283    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffj55\" (UniqueName: \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.285752 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.285664    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:39.586774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:39.586737    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:41:39.588874 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:41:39.588848    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-d3d869b6071eb0e7334b589ca6eec730199ba6a08fc7bed0e86cf6e8726c9d0e WatchSource:0}: Error finding container d3d869b6071eb0e7334b589ca6eec730199ba6a08fc7bed0e86cf6e8726c9d0e: Status 404 returned error can't find the container with id d3d869b6071eb0e7334b589ca6eec730199ba6a08fc7bed0e86cf6e8726c9d0e
Oct 30 03:41:40.356365 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:40.356328    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" event={"ID":"89f0a86a-6f21-4d85-94eb-2478ee62da2e","Type":"ContainerStarted","Data":"9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b"}
Oct 30 03:41:40.356795 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:40.356480    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:41:40.356795 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:40.356498    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" event={"ID":"89f0a86a-6f21-4d85-94eb-2478ee62da2e","Type":"ContainerStarted","Data":"d3d869b6071eb0e7334b589ca6eec730199ba6a08fc7bed0e86cf6e8726c9d0e"}
Oct 30 03:41:40.396725 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:41:40.396672    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podStartSLOduration=2.396658692 podStartE2EDuration="2.396658692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:41:40.396019084 +0000 UTC m=+2769.717598828" watchObservedRunningTime="2026-10-30 03:41:40.396658692 +0000 UTC m=+2769.718238410"
Oct 30 03:41:57.820530 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:41:57.820490    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:42:11.363101 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:11.363067    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:42:13.548798 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:13.548759    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:42:21.363399 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:21.363358    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:42:27.819563 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:27.819528    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:42:28.578813 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:28.578770    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main" containerID="cri-o://9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b" gracePeriod=45
Oct 30 03:42:31.362941 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:31.362904    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:42:41.363262 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:41.363221    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:42:41.363817 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:41.363346    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:42:51.362733 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:51.362692    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:42:57.820152 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:57.820115    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:42:58.698162 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:58.698126    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-conmon-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:42:58.698370 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:58.698339    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-conmon-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:42:58.698370 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:58.698182    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-conmon-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:42:58.698519 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:42:58.698283    4869 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0a86a_6f21_4d85_94eb_2478ee62da2e.slice/crio-conmon-9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:42:58.804008 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.803971    4869 generic.go:356] "Generic (PLEG): container finished" podID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerID="9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b" exitCode=0
Oct 30 03:42:58.804148 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.804019    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" event={"ID":"89f0a86a-6f21-4d85-94eb-2478ee62da2e","Type":"ContainerDied","Data":"9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b"}
Oct 30 03:42:58.833607 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.833570    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:42:58.922328 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.922273    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\" (UniqueName: \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\") pod \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") "
Oct 30 03:42:58.922462 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.922371    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\" (UniqueName: \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\") pod \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\" (UID: \"89f0a86a-6f21-4d85-94eb-2478ee62da2e\") "
Oct 30 03:42:58.924413 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.924389    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs" pod "89f0a86a-6f21-4d85-94eb-2478ee62da2e" (UID: "89f0a86a-6f21-4d85-94eb-2478ee62da2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:42:58.924519 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:58.924455    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55" pod "89f0a86a-6f21-4d85-94eb-2478ee62da2e" (UID: "89f0a86a-6f21-4d85-94eb-2478ee62da2e"). InnerVolumeSpecName "kube-api-access-ffj55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:42:59.023910 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.023887    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffj55\" (UniqueName: \"kubernetes.io/projected/89f0a86a-6f21-4d85-94eb-2478ee62da2e-kube-api-access-ffj55\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:42:59.023910 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.023908    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f0a86a-6f21-4d85-94eb-2478ee62da2e-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:42:59.810710 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.810671    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn" event={"ID":"89f0a86a-6f21-4d85-94eb-2478ee62da2e","Type":"ContainerDied","Data":"d3d869b6071eb0e7334b589ca6eec730199ba6a08fc7bed0e86cf6e8726c9d0e"}
Oct 30 03:42:59.810710 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.810700    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"
Oct 30 03:42:59.810965 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.810746    4869 scope.go:122] "RemoveContainer" containerID="9579ab2248b9c3fd0598a8b4fedd9889186b9961448fe5553ace6e2129bb262b"
Oct 30 03:42:59.861375 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.861347    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:42:59.875059 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:42:59.875026    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebrxvn"]
Oct 30 03:43:00.818992 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:00.818955    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" path="/var/lib/kubelet/pods/89f0a86a-6f21-4d85-94eb-2478ee62da2e/volumes"
Oct 30 03:43:03.375229 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:03.375192    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:43:05.155448 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:05.155410    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:43:15.155229 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:15.155192    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:43:18.395049 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:18.395013    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" containerID="cri-o://c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9" gracePeriod=45
Oct 30 03:43:25.155214 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:25.155172    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:43:25.155609 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:25.155280    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:43:27.820314 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:43:27.820275    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:43:35.155057 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:35.155022    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:43:45.155747 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:45.155706    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:43:48.647748 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.647720    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:43:48.705331 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.705308    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\" (UniqueName: \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\") pod \"f9df837d-016d-45b4-b8b9-44b5256efcb6\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") "
Oct 30 03:43:48.705456 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.705348    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\") pod \"f9df837d-016d-45b4-b8b9-44b5256efcb6\" (UID: \"f9df837d-016d-45b4-b8b9-44b5256efcb6\") "
Oct 30 03:43:48.707404 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.707368    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2" pod "f9df837d-016d-45b4-b8b9-44b5256efcb6" (UID: "f9df837d-016d-45b4-b8b9-44b5256efcb6"). InnerVolumeSpecName "kube-api-access-gmfj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:43:48.707529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.707435    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs" pod "f9df837d-016d-45b4-b8b9-44b5256efcb6" (UID: "f9df837d-016d-45b4-b8b9-44b5256efcb6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:43:48.806154 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.806127    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmfj2\" (UniqueName: \"kubernetes.io/projected/f9df837d-016d-45b4-b8b9-44b5256efcb6-kube-api-access-gmfj2\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:48.806154 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:48.806152    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9df837d-016d-45b4-b8b9-44b5256efcb6-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:49.068245 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.068177    4869 generic.go:356] "Generic (PLEG): container finished" podID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerID="c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9" exitCode=0
Oct 30 03:43:49.068245 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.068226    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"
Oct 30 03:43:49.068428 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.068259    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" event={"ID":"f9df837d-016d-45b4-b8b9-44b5256efcb6","Type":"ContainerDied","Data":"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"}
Oct 30 03:43:49.068428 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.068308    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq" event={"ID":"f9df837d-016d-45b4-b8b9-44b5256efcb6","Type":"ContainerDied","Data":"8e1beb1145d28b2e6e3ca113ef4b56f3208263d1b3696127bd6059c2fc71fa0d"}
Oct 30 03:43:49.068428 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.068331    4869 scope.go:122] "RemoveContainer" containerID="c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"
Oct 30 03:43:49.077175 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.077154    4869 scope.go:122] "RemoveContainer" containerID="c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"
Oct 30 03:43:49.077429 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:43:49.077408    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9\": container with ID starting with c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9 not found: ID does not exist" containerID="c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"
Oct 30 03:43:49.077499 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.077439    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9"} err="failed to get container status \"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9\": rpc error: code = NotFound desc = could not find container \"c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9\": container with ID starting with c19e01c78baeca130e03d7f2c97545a2aa54f817375a2aea20d89151c1f2bcd9 not found: ID does not exist"
Oct 30 03:43:49.118057 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.118036    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:43:49.129729 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:49.129704    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche65xzq"]
Oct 30 03:43:50.819590 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:43:50.819548    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" path="/var/lib/kubelet/pods/f9df837d-016d-45b4-b8b9-44b5256efcb6/volumes"
Oct 30 03:43:57.820258 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:43:57.820225    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:44:02.929094 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929059    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:44:02.929649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929497    4869 cpu_manager.go:414] "containerMap: removing container" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main"
Oct 30 03:44:02.929649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929514    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main"
Oct 30 03:44:02.929649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929530    4869 cpu_manager.go:414] "containerMap: removing container" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main"
Oct 30 03:44:02.929649 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929539    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main"
Oct 30 03:44:02.929807 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929654    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9df837d-016d-45b4-b8b9-44b5256efcb6" containerName="main"
Oct 30 03:44:02.929807 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.929662    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="89f0a86a-6f21-4d85-94eb-2478ee62da2e" containerName="main"
Oct 30 03:44:02.932652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.932629    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:02.950555 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.950529    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\""
Oct 30 03:44:02.950715 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.950634    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\""
Oct 30 03:44:02.958883 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.958861    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-hpj55\""
Oct 30 03:44:02.959015 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.958937    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Oct 30 03:44:02.959083 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.959034    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-szftc\""
Oct 30 03:44:02.964202 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:02.964178    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:44:03.012454 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.012429    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbbk\" (UniqueName: \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.012562 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.012469    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.113280 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.113252    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbbk\" (UniqueName: \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.113387 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.113288    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.115942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.115916    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.135827 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.135792    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbbk\" (UniqueName: \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.248303 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.248184    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:03.551855 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:03.551827    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:44:03.553965 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:03.553935    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52b0253_dee0_400b_831e_76b15e259603.slice/crio-9e16b66a62bb68c26c6c918c41156cc6581e1ae580bebd7d1d5dab5604227e28 WatchSource:0}: Error finding container 9e16b66a62bb68c26c6c918c41156cc6581e1ae580bebd7d1d5dab5604227e28: Status 404 returned error can't find the container with id 9e16b66a62bb68c26c6c918c41156cc6581e1ae580bebd7d1d5dab5604227e28
Oct 30 03:44:04.148818 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:04.148780    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerStarted","Data":"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"}
Oct 30 03:44:04.149185 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:04.148854    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerStarted","Data":"9e16b66a62bb68c26c6c918c41156cc6581e1ae580bebd7d1d5dab5604227e28"}
Oct 30 03:44:04.149185 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:04.148889    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:04.189686 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:04.189636    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podStartSLOduration=2.189623541 podStartE2EDuration="2.189623541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:44:04.187866478 +0000 UTC m=+2913.509446198" watchObservedRunningTime="2026-10-30 03:44:04.189623541 +0000 UTC m=+2913.511203253"
Oct 30 03:44:13.249858 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:13.249787    4869 logging.go:55] [core] [Channel #789 SubChannel #790]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.71:9003", ServerName: "10.132.0.71:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.71:9003: connect: connection refused"
Oct 30 03:44:14.249072 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:14.249033    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.71:9003\" within 1s: context deadline exceeded"
Oct 30 03:44:23.249700 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:23.249665    4869 logging.go:55] [core] [Channel #791 SubChannel #792]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.71:9003", ServerName: "10.132.0.71:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.71:9003: connect: connection refused"
Oct 30 03:44:24.250417 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:24.250366    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.71:9003\" within 1s: context deadline exceeded"
Oct 30 03:44:24.250840 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:24.250445    4869 logging.go:55] [core] [Channel #791 SubChannel #792]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.71:9003", ServerName: "10.132.0.71:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.71:9003: connect: connection refused"
Oct 30 03:44:27.819403 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:44:27.819366    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:44:33.249782 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:33.249750    4869 logging.go:55] [core] [Channel #793 SubChannel #794]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.71:9003", ServerName: "10.132.0.71:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.71:9003: connect: connection refused"
Oct 30 03:44:34.249812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:34.249770    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.71:9003\" within 1s: context deadline exceeded"
Oct 30 03:44:34.250274 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:34.249844    4869 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:34.250317 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:34.250270    4869 kuberuntime_manager.go:1329] "Message for Container of pod" containerName="main" containerStatusID={"Type":"cri-o","ID":"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"} pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" containerMessage="Container main failed liveness probe, will be restarted"
Oct 30 03:44:34.251652 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:34.251629    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:44:46.520525 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.520489    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:44:46.524285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.524260    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.541974 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.541943    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-rbpn4\""
Oct 30 03:44:46.544779 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.544752    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:44:46.553720 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.553692    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Oct 30 03:44:46.580205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.580176    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlh7\" (UniqueName: \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.580324 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.580250    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.681100 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.681059    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlh7\" (UniqueName: \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.681262 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.681130    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.683736 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.683704    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.703617 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.703591    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlh7\" (UniqueName: \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:46.840796 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:46.840706    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:47.146692 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:47.146659    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:44:47.148591 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:47.148549    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27adf16_d44d_469e_8dfe_993d01d0aafd.slice/crio-d41bb3b2c23e3a1994ce69de73e920fc2ace756665af61854ed1a98b718b68f2 WatchSource:0}: Error finding container d41bb3b2c23e3a1994ce69de73e920fc2ace756665af61854ed1a98b718b68f2: Status 404 returned error can't find the container with id d41bb3b2c23e3a1994ce69de73e920fc2ace756665af61854ed1a98b718b68f2
Oct 30 03:44:47.392389 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:47.392350    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" event={"ID":"e27adf16-d44d-469e-8dfe-993d01d0aafd","Type":"ContainerStarted","Data":"0da301553d2917c95c3b85e56ab2eb610ec63f150da946a1cb67a78bf4ae3543"}
Oct 30 03:44:47.392560 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:47.392414    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" event={"ID":"e27adf16-d44d-469e-8dfe-993d01d0aafd","Type":"ContainerStarted","Data":"d41bb3b2c23e3a1994ce69de73e920fc2ace756665af61854ed1a98b718b68f2"}
Oct 30 03:44:47.392560 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:47.392509    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:44:47.433858 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:47.433814    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podStartSLOduration=1.433800972 podStartE2EDuration="1.433800972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:44:47.431653238 +0000 UTC m=+2956.753232954" watchObservedRunningTime="2026-10-30 03:44:47.433800972 +0000 UTC m=+2956.755380691"
Oct 30 03:44:49.269815 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:49.269761    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" containerID="cri-o://17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28" gracePeriod=45
Oct 30 03:44:54.252303 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:54.252265    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:44:56.842979 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:44:56.842943    4869 logging.go:55] [core] [Channel #804 SubChannel #805]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.72:9003", ServerName: "10.132.0.72:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.72:9003: connect: connection refused"
Oct 30 03:44:57.819913 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:44:57.819875    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:44:57.842267 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:44:57.842237    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.72:9003\" within 1s: context deadline exceeded"
Oct 30 03:45:04.252385 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:04.252344    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:45:06.842177 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:45:06.842140    4869 logging.go:55] [core] [Channel #809 SubChannel #810]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.72:9003", ServerName: "10.132.0.72:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.72:9003: connect: connection refused"
Oct 30 03:45:07.841888 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:07.841850    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.72:9003\" within 1s: context deadline exceeded"
Oct 30 03:45:14.252105 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:14.252063    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:45:14.252605 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:14.252180    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:45:18.399898 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:18.399865    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:45:19.582716 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:19.582633    4869 generic.go:356] "Generic (PLEG): container finished" podID="b52b0253-dee0-400b-831e-76b15e259603" containerID="17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28" exitCode=0
Oct 30 03:45:19.583097 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:19.582718    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerDied","Data":"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"}
Oct 30 03:45:19.583097 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:19.582788    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerStarted","Data":"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"}
Oct 30 03:45:19.583097 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:19.582928    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:45:20.578994 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:20.578959    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:45:27.820273 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:45:27.820235    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:45:28.400774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:28.400737    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:45:31.145732 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:31.145631    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:45:31.154163 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:31.154141    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:45:35.602885 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:35.602817    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" containerID="cri-o://0da301553d2917c95c3b85e56ab2eb610ec63f150da946a1cb67a78bf4ae3543" gracePeriod=45
Oct 30 03:45:38.400446 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:38.400405    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:45:48.400469 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:48.400387    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:45:48.400865 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:48.400505    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:45:50.593320 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:50.593285    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:45:57.819701 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:45:57.819667    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:45:58.400474 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:45:58.400433    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:46:05.834194 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.834161    4869 generic.go:356] "Generic (PLEG): container finished" podID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerID="0da301553d2917c95c3b85e56ab2eb610ec63f150da946a1cb67a78bf4ae3543" exitCode=0
Oct 30 03:46:05.834664 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.834229    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" event={"ID":"e27adf16-d44d-469e-8dfe-993d01d0aafd","Type":"ContainerDied","Data":"0da301553d2917c95c3b85e56ab2eb610ec63f150da946a1cb67a78bf4ae3543"}
Oct 30 03:46:05.857252 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.857232    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:46:05.922601 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.922524    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\") pod \"e27adf16-d44d-469e-8dfe-993d01d0aafd\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") "
Oct 30 03:46:05.922703 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.922612    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\" (UniqueName: \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\") pod \"e27adf16-d44d-469e-8dfe-993d01d0aafd\" (UID: \"e27adf16-d44d-469e-8dfe-993d01d0aafd\") "
Oct 30 03:46:05.924728 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.924698    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs" pod "e27adf16-d44d-469e-8dfe-993d01d0aafd" (UID: "e27adf16-d44d-469e-8dfe-993d01d0aafd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:46:05.924848 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:05.924812    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7" pod "e27adf16-d44d-469e-8dfe-993d01d0aafd" (UID: "e27adf16-d44d-469e-8dfe-993d01d0aafd"). InnerVolumeSpecName "kube-api-access-dzlh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:46:06.023724 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.023696    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27adf16-d44d-469e-8dfe-993d01d0aafd-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:46:06.023724 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.023720    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzlh7\" (UniqueName: \"kubernetes.io/projected/e27adf16-d44d-469e-8dfe-993d01d0aafd-kube-api-access-dzlh7\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:46:06.840808 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.840775    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"
Oct 30 03:46:06.841142 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.840797    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj" event={"ID":"e27adf16-d44d-469e-8dfe-993d01d0aafd","Type":"ContainerDied","Data":"d41bb3b2c23e3a1994ce69de73e920fc2ace756665af61854ed1a98b718b68f2"}
Oct 30 03:46:06.841142 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.840902    4869 scope.go:122] "RemoveContainer" containerID="0da301553d2917c95c3b85e56ab2eb610ec63f150da946a1cb67a78bf4ae3543"
Oct 30 03:46:06.890532 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.890507    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:46:06.902113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:06.902087    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schelnkxj"]
Oct 30 03:46:08.819214 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:08.819171    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" path="/var/lib/kubelet/pods/e27adf16-d44d-469e-8dfe-993d01d0aafd/volumes"
Oct 30 03:46:10.781615 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:10.781569    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:46:20.593030 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:20.592984    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:46:25.802455 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:25.802381    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" containerID="cri-o://17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd" gracePeriod=45
Oct 30 03:46:27.819806 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:46:27.819768    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:46:30.593795 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:30.593756    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:46:40.593995 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:40.593945    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:46:40.594543 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:40.594081    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:46:50.593397 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:50.593345    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:46:56.058747 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.058688    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:46:56.094518 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.094490    4869 generic.go:356] "Generic (PLEG): container finished" podID="b52b0253-dee0-400b-831e-76b15e259603" containerID="17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd" exitCode=0
Oct 30 03:46:56.094656 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.094535    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"
Oct 30 03:46:56.094656 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.094549    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerDied","Data":"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"}
Oct 30 03:46:56.094656 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.094609    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq" event={"ID":"b52b0253-dee0-400b-831e-76b15e259603","Type":"ContainerDied","Data":"9e16b66a62bb68c26c6c918c41156cc6581e1ae580bebd7d1d5dab5604227e28"}
Oct 30 03:46:56.094656 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.094632    4869 scope.go:122] "RemoveContainer" containerID="17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"
Oct 30 03:46:56.105486 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.105461    4869 scope.go:122] "RemoveContainer" containerID="17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"
Oct 30 03:46:56.113786 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.113767    4869 scope.go:122] "RemoveContainer" containerID="17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"
Oct 30 03:46:56.114081 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:46:56.114056    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd\": container with ID starting with 17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd not found: ID does not exist" containerID="17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"
Oct 30 03:46:56.114131 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.114095    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd"} err="failed to get container status \"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd\": rpc error: code = NotFound desc = could not find container \"17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd\": container with ID starting with 17d1889cd0e57908a77b03747e3b04e4375961da98fe6d80ed6d2c6ff88bb4dd not found: ID does not exist"
Oct 30 03:46:56.114131 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.114120    4869 scope.go:122] "RemoveContainer" containerID="17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"
Oct 30 03:46:56.114392 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:46:56.114374    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28\": container with ID starting with 17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28 not found: ID does not exist" containerID="17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"
Oct 30 03:46:56.114444 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.114398    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28"} err="failed to get container status \"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28\": rpc error: code = NotFound desc = could not find container \"17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28\": container with ID starting with 17a75bb79a58aefd6970d1987a47360eb16d940690a8a3830cb8461793953c28 not found: ID does not exist"
Oct 30 03:46:56.206149 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.206127    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\" (UniqueName: \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\") pod \"b52b0253-dee0-400b-831e-76b15e259603\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") "
Oct 30 03:46:56.206249 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.206186    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\" (UniqueName: \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\") pod \"b52b0253-dee0-400b-831e-76b15e259603\" (UID: \"b52b0253-dee0-400b-831e-76b15e259603\") "
Oct 30 03:46:56.208128 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.208104    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs" pod "b52b0253-dee0-400b-831e-76b15e259603" (UID: "b52b0253-dee0-400b-831e-76b15e259603"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:46:56.208215 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.208160    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk" pod "b52b0253-dee0-400b-831e-76b15e259603" (UID: "b52b0253-dee0-400b-831e-76b15e259603"). InnerVolumeSpecName "kube-api-access-xkbbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:46:56.307246 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.307222    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52b0253-dee0-400b-831e-76b15e259603-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:46:56.307246 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.307245    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkbbk\" (UniqueName: \"kubernetes.io/projected/b52b0253-dee0-400b-831e-76b15e259603-kube-api-access-xkbbk\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:46:56.439910 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.439869    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:46:56.451340 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.451317    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schenx2rq"]
Oct 30 03:46:56.818654 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:46:56.818627    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b52b0253-dee0-400b-831e-76b15e259603" path="/var/lib/kubelet/pods/b52b0253-dee0-400b-831e-76b15e259603/volumes"
Oct 30 03:46:57.820206 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:46:57.820172    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:47:27.820161 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:47:27.820123    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:47:57.820155 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:47:57.820116    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:48:11.784926 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.784891    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785314    4869 cpu_manager.go:414] "containerMap: removing container" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785328    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785346    4869 cpu_manager.go:414] "containerMap: removing container" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785351    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785359    4869 cpu_manager.go:414] "containerMap: removing container" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785364    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785424    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:11.785481 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.785437    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="e27adf16-d44d-469e-8dfe-993d01d0aafd" containerName="main"
Oct 30 03:48:11.791863 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.791836    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.808907 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.808880    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisv20d1e8ef181cac7effb0fab7b8590b15-kserve-self-signed-certs\""
Oct 30 03:48:11.810125 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.810100    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:48:11.819067 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.819018    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"openshift-service-ca.crt\""
Oct 30 03:48:11.819236 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.819195    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"kube-root-ca.crt\""
Oct 30 03:48:11.857625 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.857596    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmffl\" (UniqueName: \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.857740 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.857663    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.908990 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.908970    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisvc-model-fb-opt-125m-oci-r-0fba19de-epp-sa-dockercfg-sh64w\""
Oct 30 03:48:11.908990 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.908970    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"default-dockercfg-nksxv\""
Oct 30 03:48:11.958529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.958500    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.958661 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.958559    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmffl\" (UniqueName: \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.961051 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.961023    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:11.984401 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:11.984374    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmffl\" (UniqueName: \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:12.105592 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.105520    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:12.404247 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.404222    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:48:12.406043 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:48:12.406015    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b5f916_1f17_49b6_9023_d5e3681b0eb8.slice/crio-eb49769ffb15aabd7315555587e3a41f70d963bba86da8e4dc63fd2eec337173 WatchSource:0}: Error finding container eb49769ffb15aabd7315555587e3a41f70d963bba86da8e4dc63fd2eec337173: Status 404 returned error can't find the container with id eb49769ffb15aabd7315555587e3a41f70d963bba86da8e4dc63fd2eec337173
Oct 30 03:48:12.497202 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.497167    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" event={"ID":"00b5f916-1f17-49b6-9023-d5e3681b0eb8","Type":"ContainerStarted","Data":"259a9a0b1024183faa3a301167b8a6091d98d7b82e89208ba15b9d2a3f26d746"}
Oct 30 03:48:12.497313 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.497228    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" event={"ID":"00b5f916-1f17-49b6-9023-d5e3681b0eb8","Type":"ContainerStarted","Data":"eb49769ffb15aabd7315555587e3a41f70d963bba86da8e4dc63fd2eec337173"}
Oct 30 03:48:12.497313 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.497260    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:12.547721 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:12.547676    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podStartSLOduration=1.547662006 podStartE2EDuration="1.547662006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:12.547012873 +0000 UTC m=+3161.868592593" watchObservedRunningTime="2026-10-30 03:48:12.547662006 +0000 UTC m=+3161.869241725"
Oct 30 03:48:27.825745 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:48:27.825681    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:48:28.126117 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.126041    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:48:28.126827 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.126806    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="b52b0253-dee0-400b-831e-76b15e259603" containerName="main"
Oct 30 03:48:28.130468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.130448    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.146741 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.146711    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:48:28.155765 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.155741    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\""
Oct 30 03:48:28.156454 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.156431    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-k7bjh\""
Oct 30 03:48:28.156542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.156462    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-kgjd6\""
Oct 30 03:48:28.156542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.156462    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\""
Oct 30 03:48:28.156542 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.156486    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Oct 30 03:48:28.302588 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.302551    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.302777 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.302754    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc525\" (UniqueName: \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.403603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.403491    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc525\" (UniqueName: \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.403603 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.403555    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.406084 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.406063    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.428840 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.428813    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc525\" (UniqueName: \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.449407 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.449374    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:28.760555 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:28.760528    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:48:28.762178 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:48:28.762151    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f323f2_a902_473d_bbd9_1cf00315ce1d.slice/crio-83925793f43408460fa66ca4fca22b58c131e8b1ee0663cf1b99ef53f5b3c397 WatchSource:0}: Error finding container 83925793f43408460fa66ca4fca22b58c131e8b1ee0663cf1b99ef53f5b3c397: Status 404 returned error can't find the container with id 83925793f43408460fa66ca4fca22b58c131e8b1ee0663cf1b99ef53f5b3c397
Oct 30 03:48:29.640781 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:29.640734    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" event={"ID":"d3f323f2-a902-473d-bbd9-1cf00315ce1d","Type":"ContainerStarted","Data":"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"}
Oct 30 03:48:29.641224 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:29.640810    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" event={"ID":"d3f323f2-a902-473d-bbd9-1cf00315ce1d","Type":"ContainerStarted","Data":"83925793f43408460fa66ca4fca22b58c131e8b1ee0663cf1b99ef53f5b3c397"}
Oct 30 03:48:29.641224 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:29.640954    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:48:29.681903 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:29.681847    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podStartSLOduration=1.681834953 podStartE2EDuration="1.681834953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:29.680109425 +0000 UTC m=+3179.001689144" watchObservedRunningTime="2026-10-30 03:48:29.681834953 +0000 UTC m=+3179.003414672"
Oct 30 03:48:43.556643 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:48:43.556559    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:48:57.820299 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:48:57.820264    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:49:00.648249 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:49:00.648217    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:49:27.820753 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:49:27.820717    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:49:57.820646 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:49:57.820605    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:50:13.086439 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:13.086398    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:50:20.647982 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:20.647937    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:27.317880 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:27.317838    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:50:27.820030 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:50:27.819985    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:50:28.110497 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:28.110411    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main" containerID="cri-o://bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539" gracePeriod=45
Oct 30 03:50:30.648685 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:30.648644    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:31.181841 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:31.181731    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:50:31.191863 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:31.191840    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:50:33.556570 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:33.556532    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:40.655332 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:40.655285    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:40.655790 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:40.655430    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:50:42.338846 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:42.338800    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main" containerID="cri-o://259a9a0b1024183faa3a301167b8a6091d98d7b82e89208ba15b9d2a3f26d746" gracePeriod=45
Oct 30 03:50:43.556099 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:43.556051    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:50.648057 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:50.648013    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:53.556268 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:53.556230    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:50:53.556671 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:53.556337    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:50:57.819869 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:50:57.819835    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:50:58.367331 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.367308    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:50:58.423966 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.423893    4869 generic.go:356] "Generic (PLEG): container finished" podID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerID="bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539" exitCode=0
Oct 30 03:50:58.423966 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.423949    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"
Oct 30 03:50:58.424153 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.423984    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" event={"ID":"d3f323f2-a902-473d-bbd9-1cf00315ce1d","Type":"ContainerDied","Data":"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"}
Oct 30 03:50:58.424153 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.424037    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs" event={"ID":"d3f323f2-a902-473d-bbd9-1cf00315ce1d","Type":"ContainerDied","Data":"83925793f43408460fa66ca4fca22b58c131e8b1ee0663cf1b99ef53f5b3c397"}
Oct 30 03:50:58.424153 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.424059    4869 scope.go:122] "RemoveContainer" containerID="bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"
Oct 30 03:50:58.433939 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.433919    4869 scope.go:122] "RemoveContainer" containerID="bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"
Oct 30 03:50:58.434210 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:50:58.434191    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539\": container with ID starting with bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539 not found: ID does not exist" containerID="bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"
Oct 30 03:50:58.434267 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.434220    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539"} err="failed to get container status \"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539\": rpc error: code = NotFound desc = could not find container \"bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539\": container with ID starting with bb2fc7b331f6df732caa305a13db35b87ed6c3bf332c5cc8e14c9dddd612b539 not found: ID does not exist"
Oct 30 03:50:58.484686 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.484666    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\") pod \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") "
Oct 30 03:50:58.484799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.484733    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\" (UniqueName: \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\") pod \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\" (UID: \"d3f323f2-a902-473d-bbd9-1cf00315ce1d\") "
Oct 30 03:50:58.486850 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.486820    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs" pod "d3f323f2-a902-473d-bbd9-1cf00315ce1d" (UID: "d3f323f2-a902-473d-bbd9-1cf00315ce1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:50:58.486935 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.486896    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525" pod "d3f323f2-a902-473d-bbd9-1cf00315ce1d" (UID: "d3f323f2-a902-473d-bbd9-1cf00315ce1d"). InnerVolumeSpecName "kube-api-access-vc525". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:50:58.586054 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.586029    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc525\" (UniqueName: \"kubernetes.io/projected/d3f323f2-a902-473d-bbd9-1cf00315ce1d-kube-api-access-vc525\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:58.586054 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.586052    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f323f2-a902-473d-bbd9-1cf00315ce1d-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:58.767539 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.767513    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:50:58.779146 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.779126    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenbjcs"]
Oct 30 03:50:58.819654 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:50:58.819631    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" path="/var/lib/kubelet/pods/d3f323f2-a902-473d-bbd9-1cf00315ce1d/volumes"
Oct 30 03:51:03.556189 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:03.556147    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:51:12.507949 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.507845    4869 generic.go:356] "Generic (PLEG): container finished" podID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerID="259a9a0b1024183faa3a301167b8a6091d98d7b82e89208ba15b9d2a3f26d746" exitCode=0
Oct 30 03:51:12.508342 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.507924    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" event={"ID":"00b5f916-1f17-49b6-9023-d5e3681b0eb8","Type":"ContainerDied","Data":"259a9a0b1024183faa3a301167b8a6091d98d7b82e89208ba15b9d2a3f26d746"}
Oct 30 03:51:12.592915 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.592888    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:51:12.708713 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.708687    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\" (UniqueName: \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\") pod \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") "
Oct 30 03:51:12.708849 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.708749    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\" (UniqueName: \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\") pod \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\" (UID: \"00b5f916-1f17-49b6-9023-d5e3681b0eb8\") "
Oct 30 03:51:12.710890 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.710861    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl" pod "00b5f916-1f17-49b6-9023-d5e3681b0eb8" (UID: "00b5f916-1f17-49b6-9023-d5e3681b0eb8"). InnerVolumeSpecName "kube-api-access-vmffl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:51:12.710995 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.710923    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs" pod "00b5f916-1f17-49b6-9023-d5e3681b0eb8" (UID: "00b5f916-1f17-49b6-9023-d5e3681b0eb8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:51:12.809570 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.809542    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmffl\" (UniqueName: \"kubernetes.io/projected/00b5f916-1f17-49b6-9023-d5e3681b0eb8-kube-api-access-vmffl\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:51:12.809679 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:12.809572    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b5f916-1f17-49b6-9023-d5e3681b0eb8-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:51:13.514837 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:13.514808    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"
Oct 30 03:51:13.515239 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:13.514802    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf" event={"ID":"00b5f916-1f17-49b6-9023-d5e3681b0eb8","Type":"ContainerDied","Data":"eb49769ffb15aabd7315555587e3a41f70d963bba86da8e4dc63fd2eec337173"}
Oct 30 03:51:13.515239 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:13.515003    4869 scope.go:122] "RemoveContainer" containerID="259a9a0b1024183faa3a301167b8a6091d98d7b82e89208ba15b9d2a3f26d746"
Oct 30 03:51:13.564653 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:13.564629    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:51:13.576455 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:13.576422    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2v6tf"]
Oct 30 03:51:14.819773 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:14.819738    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" path="/var/lib/kubelet/pods/00b5f916-1f17-49b6-9023-d5e3681b0eb8/volumes"
Oct 30 03:51:21.414827 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.414788    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:51:21.415418 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415401    4869 cpu_manager.go:414] "containerMap: removing container" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main"
Oct 30 03:51:21.415468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415421    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main"
Oct 30 03:51:21.415468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415438    4869 cpu_manager.go:414] "containerMap: removing container" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main"
Oct 30 03:51:21.415468 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415446    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main"
Oct 30 03:51:21.415563 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415539    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3f323f2-a902-473d-bbd9-1cf00315ce1d" containerName="main"
Oct 30 03:51:21.415563 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.415550    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="00b5f916-1f17-49b6-9023-d5e3681b0eb8" containerName="main"
Oct 30 03:51:21.420419 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.420394    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.435850 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.435826    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"custom-route-timeout-test-kserve-self-signed-certs\""
Oct 30 03:51:21.436274 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.436248    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:51:21.447538 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.447502    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"default-dockercfg-b6qz6\""
Oct 30 03:51:21.447671 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.447549    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"openshift-service-ca.crt\""
Oct 30 03:51:21.447671 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.447552    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"custom-route-timeout-test-epp-sa-dockercfg-rbcwd\""
Oct 30 03:51:21.447671 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.447571    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-caba0b4a\"/\"kube-root-ca.crt\""
Oct 30 03:51:21.474861 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.474827    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.474968 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.474936    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mm92\" (UniqueName: \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.576483 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.576447    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.576662 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.576538    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mm92\" (UniqueName: \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.578992 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.578968    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.599028 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.599005    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mm92\" (UniqueName: \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\") pod \"custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") " pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:21.738309 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:21.738275    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:22.041774 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:22.041744    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:51:22.043901 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:51:22.043868    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463f45f1_c05a_49ca_9f6e_5f4c644f8246.slice/crio-0e626e36e474c3ccd7bb344043dd15cdaad0cc7cb1c75aaa06bee0a7a3f8948f WatchSource:0}: Error finding container 0e626e36e474c3ccd7bb344043dd15cdaad0cc7cb1c75aaa06bee0a7a3f8948f: Status 404 returned error can't find the container with id 0e626e36e474c3ccd7bb344043dd15cdaad0cc7cb1c75aaa06bee0a7a3f8948f
Oct 30 03:51:22.570244 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:22.570199    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" event={"ID":"463f45f1-c05a-49ca-9f6e-5f4c644f8246","Type":"ContainerStarted","Data":"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"}
Oct 30 03:51:22.570781 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:22.570272    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" event={"ID":"463f45f1-c05a-49ca-9f6e-5f4c644f8246","Type":"ContainerStarted","Data":"0e626e36e474c3ccd7bb344043dd15cdaad0cc7cb1c75aaa06bee0a7a3f8948f"}
Oct 30 03:51:22.573211 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:22.572863    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:22.614021 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:22.613969    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podStartSLOduration=1.6139558200000002 podStartE2EDuration="1.61395582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:51:22.612251144 +0000 UTC m=+3351.933830863" watchObservedRunningTime="2026-10-30 03:51:22.61395582 +0000 UTC m=+3351.935535538"
Oct 30 03:51:27.819960 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:51:27.819925    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:51:54.583913 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:51:54.583881    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:51:57.820266 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:51:57.820226    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:52:27.819903 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:52:27.819865    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:52:57.819753 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:52:57.819715    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:53:27.819860 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:53:27.819820    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:53:37.154305 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.154267    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:53:37.158364 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.158339    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.174018 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.173980    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-n4xll\""
Oct 30 03:53:37.176627 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.176600    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:53:37.185467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.185446    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-c9qsd\""
Oct 30 03:53:37.185817 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.185801    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\""
Oct 30 03:53:37.185958 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.185938    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\""
Oct 30 03:53:37.248223 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.248193    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.248357 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.248258    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgmk\" (UniqueName: \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.274264 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.274241    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\""
Oct 30 03:53:37.349711 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.349687    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.349814 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.349727    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgmk\" (UniqueName: \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.352309 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.352288    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.372528 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.372500    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgmk\" (UniqueName: \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\") pod \"stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.473275 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.473252    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:37.790296 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:37.790218    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:53:37.794096 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:53:37.794061    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2bd298_349d_4d40_a8fa_2ef5485fead6.slice/crio-3a4e95c12e988aca96ea52f20a77f3021fc754748dfd907749f51fa1ab67342a WatchSource:0}: Error finding container 3a4e95c12e988aca96ea52f20a77f3021fc754748dfd907749f51fa1ab67342a: Status 404 returned error can't find the container with id 3a4e95c12e988aca96ea52f20a77f3021fc754748dfd907749f51fa1ab67342a
Oct 30 03:53:38.290872 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:38.290830    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" event={"ID":"7d2bd298-349d-4d40-a8fa-2ef5485fead6","Type":"ContainerStarted","Data":"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"}
Oct 30 03:53:38.291347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:38.290931    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" event={"ID":"7d2bd298-349d-4d40-a8fa-2ef5485fead6","Type":"ContainerStarted","Data":"3a4e95c12e988aca96ea52f20a77f3021fc754748dfd907749f51fa1ab67342a"}
Oct 30 03:53:38.291347 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:38.290963    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:53:38.331361 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:38.331312    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podStartSLOduration=1.331300433 podStartE2EDuration="1.331300433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:53:38.33043659 +0000 UTC m=+3487.652016309" watchObservedRunningTime="2026-10-30 03:53:38.331300433 +0000 UTC m=+3487.652880152"
Oct 30 03:53:39.179398 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:39.179361    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:53:44.584041 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:44.584000    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:53:47.475164 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:53:47.475133    4869 logging.go:55] [core] [Channel #1093 SubChannel #1094]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.76:9003", ServerName: "10.132.0.76:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.76:9003: connect: connection refused"
Oct 30 03:53:48.474351 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:48.474310    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.76:9003\" within 1s: context deadline exceeded"
Oct 30 03:53:54.209764 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:54.209696    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main" containerID="cri-o://afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395" gracePeriod=45
Oct 30 03:53:54.583907 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:53:54.583873    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:53:57.819477 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:53:57.819441    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:54:04.583789 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:04.583749    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:54:04.584215 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:04.583850    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:54:04.723530 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:04.723493    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:54:04.723766 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:04.723716    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" containerID="cri-o://1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde" gracePeriod=30
Oct 30 03:54:08.797885 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:08.797836    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 03:54:08.798274 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:08.797924    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:54:09.308449 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:09.308420    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:54:09.976385 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:09.976359    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:54:10.104784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104709    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.104784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104765    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104811    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104839    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104865    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104885    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104922    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104953    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105000 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.104993    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\") pod \"886df68e-ee3a-4523-aca1-1e60b6c57f86\" (UID: \"886df68e-ee3a-4523-aca1-1e60b6c57f86\") "
Oct 30 03:54:10.105326 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105185    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:54:10.105326 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105210    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:54:10.105444 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105350    4869 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.105444 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105369    4869 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-credential-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.105444 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105396    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:54:10.105635 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105607    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:54:10.105766 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.105743    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:54:10.107014 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.106993    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "kube-api-access-fdn9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:54:10.107228 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.107211    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:54:10.107416 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.107395    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:54:10.107484 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.107431    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo" pod "886df68e-ee3a-4523-aca1-1e60b6c57f86" (UID: "886df68e-ee3a-4523-aca1-1e60b6c57f86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 03:54:10.206307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206277    4869 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886df68e-ee3a-4523-aca1-1e60b6c57f86-istiod-ca-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206305    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdn9l\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-kube-api-access-fdn9l\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206323    4869 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-podinfo\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206336    4869 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-workload-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206349    4869 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-envoy\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206362    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.206467 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.206373    4869 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886df68e-ee3a-4523-aca1-1e60b6c57f86-istio-data\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:10.474838 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.474808    4869 generic.go:356] "Generic (PLEG): container finished" podID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerID="1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde" exitCode=0
Oct 30 03:54:10.475003 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.474848    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"
Oct 30 03:54:10.475003 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.474890    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" event={"ID":"886df68e-ee3a-4523-aca1-1e60b6c57f86","Type":"ContainerDied","Data":"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"}
Oct 30 03:54:10.475003 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.474958    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r" event={"ID":"886df68e-ee3a-4523-aca1-1e60b6c57f86","Type":"ContainerDied","Data":"9c58d9fd437a0de43ab18dc6083ef839515fa3546cbf3d13e4277bd1cb958a48"}
Oct 30 03:54:10.475003 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.474989    4869 scope.go:122] "RemoveContainer" containerID="1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"
Oct 30 03:54:10.485092 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.485075    4869 scope.go:122] "RemoveContainer" containerID="1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"
Oct 30 03:54:10.485343 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:54:10.485324    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde\": container with ID starting with 1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde not found: ID does not exist" containerID="1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"
Oct 30 03:54:10.485386 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.485351    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde"} err="failed to get container status \"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde\": rpc error: code = NotFound desc = could not find container \"1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde\": container with ID starting with 1617a687ab34bcce059e01bbb7a6cca65fd690e94fdaace0adba7c4f33ebfcde not found: ID does not exist"
Oct 30 03:54:10.524968 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.524945    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:54:10.537078 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.537055    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-vpd7r"]
Oct 30 03:54:10.819479 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:10.819419    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" path="/var/lib/kubelet/pods/886df68e-ee3a-4523-aca1-1e60b6c57f86/volumes"
Oct 30 03:54:14.583923 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:14.583881    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:54:24.466758 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.466695    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:54:24.548060 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.548032    4869 generic.go:356] "Generic (PLEG): container finished" podID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerID="afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395" exitCode=0
Oct 30 03:54:24.548199 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.548079    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"
Oct 30 03:54:24.548199 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.548115    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" event={"ID":"463f45f1-c05a-49ca-9f6e-5f4c644f8246","Type":"ContainerDied","Data":"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"}
Oct 30 03:54:24.548199 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.548173    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2" event={"ID":"463f45f1-c05a-49ca-9f6e-5f4c644f8246","Type":"ContainerDied","Data":"0e626e36e474c3ccd7bb344043dd15cdaad0cc7cb1c75aaa06bee0a7a3f8948f"}
Oct 30 03:54:24.548301 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.548201    4869 scope.go:122] "RemoveContainer" containerID="afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"
Oct 30 03:54:24.556831 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.556815    4869 scope.go:122] "RemoveContainer" containerID="afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"
Oct 30 03:54:24.557108 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:54:24.557089    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395\": container with ID starting with afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395 not found: ID does not exist" containerID="afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"
Oct 30 03:54:24.557164 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.557117    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395"} err="failed to get container status \"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395\": rpc error: code = NotFound desc = could not find container \"afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395\": container with ID starting with afb6b7cabc6f181f54b40b8f7a9702c68e66627a92f1503dc3192a6cec04a395 not found: ID does not exist"
Oct 30 03:54:24.618292 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.618269    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\" (UniqueName: \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\") pod \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") "
Oct 30 03:54:24.618398 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.618352    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\" (UniqueName: \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\") pod \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\" (UID: \"463f45f1-c05a-49ca-9f6e-5f4c644f8246\") "
Oct 30 03:54:24.620409 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.620387    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs" pod "463f45f1-c05a-49ca-9f6e-5f4c644f8246" (UID: "463f45f1-c05a-49ca-9f6e-5f4c644f8246"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:54:24.620496 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.620390    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92" pod "463f45f1-c05a-49ca-9f6e-5f4c644f8246" (UID: "463f45f1-c05a-49ca-9f6e-5f4c644f8246"). InnerVolumeSpecName "kube-api-access-8mm92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:54:24.719500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.719437    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mm92\" (UniqueName: \"kubernetes.io/projected/463f45f1-c05a-49ca-9f6e-5f4c644f8246-kube-api-access-8mm92\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:24.719500 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.719472    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/463f45f1-c05a-49ca-9f6e-5f4c644f8246-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:54:24.886285 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.886258    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:54:24.897766 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:24.897741    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-caba0b4a/custom-route-timeout-test-kserve-router-scheduler-5c6b9d546n4f2"]
Oct 30 03:54:26.826597 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:26.826539    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" path="/var/lib/kubelet/pods/463f45f1-c05a-49ca-9f6e-5f4c644f8246/volumes"
Oct 30 03:54:27.820067 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:54:27.820033    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:54:31.705980 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.705944    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:54:31.706373 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706356    4869 cpu_manager.go:414] "containerMap: removing container" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy"
Oct 30 03:54:31.706373 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706369    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy"
Oct 30 03:54:31.706453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706382    4869 cpu_manager.go:414] "containerMap: removing container" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main"
Oct 30 03:54:31.706453 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706387    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main"
Oct 30 03:54:31.706524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706471    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="463f45f1-c05a-49ca-9f6e-5f4c644f8246" containerName="main"
Oct 30 03:54:31.706524 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.706485    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="886df68e-ee3a-4523-aca1-1e60b6c57f86" containerName="istio-proxy"
Oct 30 03:54:31.711110 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.711086    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.729463 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.729436    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:54:31.738474 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.738422    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"kube-root-ca.crt\""
Oct 30 03:54:31.738474 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.738446    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-epp-sa-dockercfg-px67b\""
Oct 30 03:54:31.738474 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.738453    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"openshift-service-ca.crt\""
Oct 30 03:54:31.740118 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.740097    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"default-dockercfg-lhj4b\""
Oct 30 03:54:31.740230 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.740170    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-kserve-self-signed-certs\""
Oct 30 03:54:31.775312 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.775284    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7h6\" (UniqueName: \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.775464 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.775445    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.876910 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.876874    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.877084 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.876918    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7h6\" (UniqueName: \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.879330 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.879302    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:31.900038 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:31.900006    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7h6\" (UniqueName: \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\") pod \"router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:32.041767 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.041687    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:32.341758 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.341635    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:54:32.344089 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:54:32.344057    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abe5fdf_3396_4655_9264_b7f1880cd896.slice/crio-9cf87125e97074ac2fada1fa367c041ea1a1093f3d1f5aa2237365a66dc8ac93 WatchSource:0}: Error finding container 9cf87125e97074ac2fada1fa367c041ea1a1093f3d1f5aa2237365a66dc8ac93: Status 404 returned error can't find the container with id 9cf87125e97074ac2fada1fa367c041ea1a1093f3d1f5aa2237365a66dc8ac93
Oct 30 03:54:32.596289 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.596195    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" event={"ID":"2abe5fdf-3396-4655-9264-b7f1880cd896","Type":"ContainerStarted","Data":"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"}
Oct 30 03:54:32.596445 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.596303    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" event={"ID":"2abe5fdf-3396-4655-9264-b7f1880cd896","Type":"ContainerStarted","Data":"9cf87125e97074ac2fada1fa367c041ea1a1093f3d1f5aa2237365a66dc8ac93"}
Oct 30 03:54:32.596445 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.596334    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:54:32.638482 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:32.638426    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podStartSLOduration=1.638412701 podStartE2EDuration="1.638412701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:54:32.636010653 +0000 UTC m=+3541.957590372" watchObservedRunningTime="2026-10-30 03:54:32.638412701 +0000 UTC m=+3541.959992413"
Oct 30 03:54:42.043811 ip-10-0-136-202 kubenswrapper[4869]: W1030 03:54:42.043775    4869 logging.go:55] [core] [Channel #1131 SubChannel #1132]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.77:9003", ServerName: "10.132.0.77:9003", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.77:9003: connect: connection refused"
Oct 30 03:54:43.042799 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:54:43.042756    4869 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.132.0.77:9003\" within 1s: context deadline exceeded"
Oct 30 03:54:57.821162 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:54:57.821124    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:55:03.603277 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:03.603244    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:55:27.820924 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:55:27.820886    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:55:31.216163 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:31.216132    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:55:31.226858 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:31.226836    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 03:55:39.323132 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:39.323094    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:55:54.348744 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:54.348700    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main" containerID="cri-o://52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a" gracePeriod=45
Oct 30 03:55:57.819964 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:55:57.819927    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:55:59.308927 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:55:59.308886    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:56:09.308564 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:09.308526    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:56:19.309287 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:19.309199    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:56:19.309705 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:19.309317    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:56:24.608853 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.608798    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:56:24.649979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.649446    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\") pod \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") "
Oct 30 03:56:24.649979 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.649497    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\" (UniqueName: \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\") pod \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\" (UID: \"7d2bd298-349d-4d40-a8fa-2ef5485fead6\") "
Oct 30 03:56:24.652104 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.652075    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs" pod "7d2bd298-349d-4d40-a8fa-2ef5485fead6" (UID: "7d2bd298-349d-4d40-a8fa-2ef5485fead6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:56:24.652220 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.652154    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk" pod "7d2bd298-349d-4d40-a8fa-2ef5485fead6" (UID: "7d2bd298-349d-4d40-a8fa-2ef5485fead6"). InnerVolumeSpecName "kube-api-access-rmgmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:56:24.751061 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.751037    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2bd298-349d-4d40-a8fa-2ef5485fead6-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:56:24.751061 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:24.751061    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmgmk\" (UniqueName: \"kubernetes.io/projected/7d2bd298-349d-4d40-a8fa-2ef5485fead6-kube-api-access-rmgmk\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:56:25.181307 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.181275    4869 generic.go:356] "Generic (PLEG): container finished" podID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerID="52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a" exitCode=0
Oct 30 03:56:25.181452 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.181321    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"
Oct 30 03:56:25.181452 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.181356    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" event={"ID":"7d2bd298-349d-4d40-a8fa-2ef5485fead6","Type":"ContainerDied","Data":"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"}
Oct 30 03:56:25.181452 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.181413    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h" event={"ID":"7d2bd298-349d-4d40-a8fa-2ef5485fead6","Type":"ContainerDied","Data":"3a4e95c12e988aca96ea52f20a77f3021fc754748dfd907749f51fa1ab67342a"}
Oct 30 03:56:25.181452 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.181436    4869 scope.go:122] "RemoveContainer" containerID="52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"
Oct 30 03:56:25.190565 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.190543    4869 scope.go:122] "RemoveContainer" containerID="52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"
Oct 30 03:56:25.190930 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:56:25.190909    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a\": container with ID starting with 52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a not found: ID does not exist" containerID="52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"
Oct 30 03:56:25.190996 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.190937    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a"} err="failed to get container status \"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a\": rpc error: code = NotFound desc = could not find container \"52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a\": container with ID starting with 52dde5e0797e0e550226c1abcf3362f20a8ad6e2adb40af067248e104ac9426a not found: ID does not exist"
Oct 30 03:56:25.232037 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.232011    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:56:25.243729 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:25.243705    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-6c5444664c-55n4h"]
Oct 30 03:56:26.818961 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:26.818923    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" path="/var/lib/kubelet/pods/7d2bd298-349d-4d40-a8fa-2ef5485fead6/volumes"
Oct 30 03:56:27.820288 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:56:27.820258    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:56:37.623339 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:37.623301    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:56:43.604292 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:43.604242    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:56:52.644709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:52.644630    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" containerID="cri-o://b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4" gracePeriod=45
Oct 30 03:56:53.604144 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:56:53.604104    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:56:57.819847 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:56:57.819809    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:57:03.604141 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:03.604099    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:57:03.604676 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:03.604212    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:57:13.603397 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:13.603355    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:57:22.910203 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:22.910143    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:57:22.994332 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:22.994304    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\" (UniqueName: \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\") pod \"2abe5fdf-3396-4655-9264-b7f1880cd896\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") "
Oct 30 03:57:22.994480 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:22.994344    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\" (UniqueName: \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\") pod \"2abe5fdf-3396-4655-9264-b7f1880cd896\" (UID: \"2abe5fdf-3396-4655-9264-b7f1880cd896\") "
Oct 30 03:57:22.996376 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:22.996347    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs" pod "2abe5fdf-3396-4655-9264-b7f1880cd896" (UID: "2abe5fdf-3396-4655-9264-b7f1880cd896"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:57:22.996487 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:22.996432    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6" pod "2abe5fdf-3396-4655-9264-b7f1880cd896" (UID: "2abe5fdf-3396-4655-9264-b7f1880cd896"). InnerVolumeSpecName "kube-api-access-fm7h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:57:23.095170 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.095142    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abe5fdf-3396-4655-9264-b7f1880cd896-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:57:23.095170 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.095169    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm7h6\" (UniqueName: \"kubernetes.io/projected/2abe5fdf-3396-4655-9264-b7f1880cd896-kube-api-access-fm7h6\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:57:23.481075 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.481034    4869 generic.go:356] "Generic (PLEG): container finished" podID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerID="b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4" exitCode=0
Oct 30 03:57:23.481075 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.481072    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"
Oct 30 03:57:23.481278 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.481085    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" event={"ID":"2abe5fdf-3396-4655-9264-b7f1880cd896","Type":"ContainerDied","Data":"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"}
Oct 30 03:57:23.481278 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.481145    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv" event={"ID":"2abe5fdf-3396-4655-9264-b7f1880cd896","Type":"ContainerDied","Data":"9cf87125e97074ac2fada1fa367c041ea1a1093f3d1f5aa2237365a66dc8ac93"}
Oct 30 03:57:23.481278 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.481179    4869 scope.go:122] "RemoveContainer" containerID="b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"
Oct 30 03:57:23.493673 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.493649    4869 scope.go:122] "RemoveContainer" containerID="b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"
Oct 30 03:57:23.494052 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:57:23.494030    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4\": container with ID starting with b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4 not found: ID does not exist" containerID="b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"
Oct 30 03:57:23.494127 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.494060    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4"} err="failed to get container status \"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4\": rpc error: code = NotFound desc = could not find container \"b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4\": container with ID starting with b720b87c014765465d6ef20d344098530876ac9e0a390812f5f02c725d6cd9b4 not found: ID does not exist"
Oct 30 03:57:23.531755 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.531726    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:57:23.543219 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:23.543193    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-57f69774b-lz8lv"]
Oct 30 03:57:24.819137 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:24.819101    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" path="/var/lib/kubelet/pods/2abe5fdf-3396-4655-9264-b7f1880cd896/volumes"
Oct 30 03:57:27.819850 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:57:27.819807    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:57:31.950640 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.950608    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 03:57:31.951122 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951024    4869 cpu_manager.go:414] "containerMap: removing container" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main"
Oct 30 03:57:31.951122 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951035    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main"
Oct 30 03:57:31.951122 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951045    4869 cpu_manager.go:414] "containerMap: removing container" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main"
Oct 30 03:57:31.951122 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951051    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main"
Oct 30 03:57:31.951335 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951128    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2bd298-349d-4d40-a8fa-2ef5485fead6" containerName="main"
Oct 30 03:57:31.951335 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.951134    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="2abe5fdf-3396-4655-9264-b7f1880cd896" containerName="main"
Oct 30 03:57:31.955680 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.955658    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:31.973205 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.973182    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 03:57:31.981942 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.981916    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"openshift-service-ca.crt\""
Oct 30 03:57:31.982081 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.981928    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"kube-root-ca.crt\""
Oct 30 03:57:31.984418 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.984389    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Oct 30 03:57:31.984509 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.984433    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa-dockercfg-96tj5\""
Oct 30 03:57:31.984509 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:31.984444    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"default-dockercfg-wst2f\""
Oct 30 03:57:32.065351 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.065323    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.065463 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.065403    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2t4\" (UniqueName: \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.166241 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.166203    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.166400 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.166290    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2t4\" (UniqueName: \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.168784 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.168760    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.189369 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.189334    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2t4\" (UniqueName: \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\") pod \"llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.274163 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.274096    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:32.583009 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:32.579705    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 03:57:33.537113 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:33.537064    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" event={"ID":"994b3360-da30-408a-baad-b01ed9def450","Type":"ContainerStarted","Data":"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"}
Oct 30 03:57:33.537622 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:33.537123    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" event={"ID":"994b3360-da30-408a-baad-b01ed9def450","Type":"ContainerStarted","Data":"fa9fc6cab9e0e2c06513fb8ad2af775c0dba5c8abb9dcc456cf6499181565b3d"}
Oct 30 03:57:33.537622 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:33.537162    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:57:33.579900 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:57:33.579839    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podStartSLOduration=2.5798196620000002 podStartE2EDuration="2.579819662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:57:33.579493062 +0000 UTC m=+3722.901072781" watchObservedRunningTime="2026-10-30 03:57:33.579819662 +0000 UTC m=+3722.901399385"
Oct 30 03:57:57.819982 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:57:57.819942    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:58:04.543888 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:04.543850    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 03:58:05.189190 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:05.189156    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:58:05.189360 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:05.189335    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" containerID="cri-o://773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216" gracePeriod=30
Oct 30 03:58:08.845308 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:08.845266    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 03:58:08.845759 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:08.845319    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:58:10.437391 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.437367    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:58:10.467788 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467742    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.467788 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467779    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.467933 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467801    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.467933 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467825    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.467933 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467848    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.467933 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467882    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.468126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.467954    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.468126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468040    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.468126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468060    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\") pod \"be994ad2-5ec5-42fa-9141-138de3932f76\" (UID: \"be994ad2-5ec5-42fa-9141-138de3932f76\") "
Oct 30 03:58:10.468126 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468109    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:58:10.468336 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468156    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:58:10.468394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468351    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:58:10.468394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468363    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:58:10.468394 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468277    4869 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be994ad2-5ec5-42fa-9141-138de3932f76-istiod-ca-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.468554 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468411    4869 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-credential-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.468554 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.468389    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:58:10.470377 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.470349    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 03:58:10.470516 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.470495    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:58:10.470694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.470664    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "kube-api-access-rfjlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:58:10.470694 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.470662    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token" pod "be994ad2-5ec5-42fa-9141-138de3932f76" (UID: "be994ad2-5ec5-42fa-9141-138de3932f76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:58:10.569040 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569013    4869 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569040 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569037    4869 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-workload-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569046    4869 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be994ad2-5ec5-42fa-9141-138de3932f76-istio-podinfo\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569055    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569064    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfjlt\" (UniqueName: \"kubernetes.io/projected/be994ad2-5ec5-42fa-9141-138de3932f76-kube-api-access-rfjlt\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569074    4869 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-data\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.569200 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.569083    4869 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be994ad2-5ec5-42fa-9141-138de3932f76-istio-envoy\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 03:58:10.729529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.729451    4869 generic.go:356] "Generic (PLEG): container finished" podID="be994ad2-5ec5-42fa-9141-138de3932f76" containerID="773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216" exitCode=0
Oct 30 03:58:10.729529 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.729498    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"
Oct 30 03:58:10.729709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.729541    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" event={"ID":"be994ad2-5ec5-42fa-9141-138de3932f76","Type":"ContainerDied","Data":"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"}
Oct 30 03:58:10.729709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.729614    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv" event={"ID":"be994ad2-5ec5-42fa-9141-138de3932f76","Type":"ContainerDied","Data":"b00a9debaea8160c8147dc0eb36a9222d96de3d7bc8f36f89bbc6163d9e5af9d"}
Oct 30 03:58:10.729709 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.729639    4869 scope.go:122] "RemoveContainer" containerID="773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"
Oct 30 03:58:10.739198 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.739182    4869 scope.go:122] "RemoveContainer" containerID="773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"
Oct 30 03:58:10.739460 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:58:10.739443    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216\": container with ID starting with 773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216 not found: ID does not exist" containerID="773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"
Oct 30 03:58:10.739523 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.739471    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216"} err="failed to get container status \"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216\": rpc error: code = NotFound desc = could not find container \"773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216\": container with ID starting with 773da39e4d038d34791dc2244e7467cb17a6fd7a9f78512c466ce5334721b216 not found: ID does not exist"
Oct 30 03:58:10.779812 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.779784    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:58:10.784103 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.784085    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-cw4jv"]
Oct 30 03:58:10.819684 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:58:10.819652    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" path="/var/lib/kubelet/pods/be994ad2-5ec5-42fa-9141-138de3932f76/volumes"
Oct 30 03:58:27.819967 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:58:27.819930    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:58:57.819866 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:58:57.819828    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:59:27.820039 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:59:27.819997    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 03:59:42.031148 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:59:42.031108    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 03:59:44.544473 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:59:44.544431    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:59:54.544327 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:59:54.544290    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 03:59:57.051669 ip-10-0-136-202 kubenswrapper[4869]: I1030 03:59:57.051606    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" containerID="cri-o://b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075" gracePeriod=45
Oct 30 03:59:57.819457 ip-10-0-136-202 kubenswrapper[4869]: E1030 03:59:57.819424    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:00:04.544364 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:04.544317    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:00:04.544957 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:04.544429    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 04:00:14.544063 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:14.544023    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:00:24.544733 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:24.544687    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:00:27.299060 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.299034    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 04:00:27.415370 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.415299    4869 generic.go:356] "Generic (PLEG): container finished" podID="994b3360-da30-408a-baad-b01ed9def450" containerID="b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075" exitCode=0
Oct 30 04:00:27.415370 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.415353    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"
Oct 30 04:00:27.415526 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.415392    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" event={"ID":"994b3360-da30-408a-baad-b01ed9def450","Type":"ContainerDied","Data":"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"}
Oct 30 04:00:27.415526 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.415446    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54" event={"ID":"994b3360-da30-408a-baad-b01ed9def450","Type":"ContainerDied","Data":"fa9fc6cab9e0e2c06513fb8ad2af775c0dba5c8abb9dcc456cf6499181565b3d"}
Oct 30 04:00:27.415526 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.415468    4869 scope.go:122] "RemoveContainer" containerID="b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"
Oct 30 04:00:27.419676 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.419655    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\" (UniqueName: \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\") pod \"994b3360-da30-408a-baad-b01ed9def450\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") "
Oct 30 04:00:27.419787 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.419702    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\" (UniqueName: \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\") pod \"994b3360-da30-408a-baad-b01ed9def450\" (UID: \"994b3360-da30-408a-baad-b01ed9def450\") "
Oct 30 04:00:27.421836 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.421808    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4" pod "994b3360-da30-408a-baad-b01ed9def450" (UID: "994b3360-da30-408a-baad-b01ed9def450"). InnerVolumeSpecName "kube-api-access-tt2t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:00:27.422035 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.422009    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs" pod "994b3360-da30-408a-baad-b01ed9def450" (UID: "994b3360-da30-408a-baad-b01ed9def450"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:00:27.424799 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.424778    4869 scope.go:122] "RemoveContainer" containerID="b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"
Oct 30 04:00:27.425100 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:00:27.425077    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075\": container with ID starting with b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075 not found: ID does not exist" containerID="b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"
Oct 30 04:00:27.425196 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.425108    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075"} err="failed to get container status \"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075\": rpc error: code = NotFound desc = could not find container \"b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075\": container with ID starting with b713f6146a54a6543e6c7c109998f628d46ccdd4f8732bb5ec4df19f1a7d2075 not found: ID does not exist"
Oct 30 04:00:27.521206 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.521182    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/994b3360-da30-408a-baad-b01ed9def450-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:00:27.521206 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.521202    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt2t4\" (UniqueName: \"kubernetes.io/projected/994b3360-da30-408a-baad-b01ed9def450-kube-api-access-tt2t4\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:00:27.759401 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.759376    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 04:00:27.771017 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:27.770994    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche75k54"]
Oct 30 04:00:27.820733 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:00:27.820707    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:00:28.818249 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:28.818213    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="994b3360-da30-408a-baad-b01ed9def450" path="/var/lib/kubelet/pods/994b3360-da30-408a-baad-b01ed9def450/volumes"
Oct 30 04:00:31.250061 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:31.249951    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:00:31.262468 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:31.262448    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:00:35.914646 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.914609    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:00:35.915265 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915243    4869 cpu_manager.go:414] "containerMap: removing container" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy"
Oct 30 04:00:35.915314 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915270    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy"
Oct 30 04:00:35.915314 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915287    4869 cpu_manager.go:414] "containerMap: removing container" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main"
Oct 30 04:00:35.915314 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915297    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main"
Oct 30 04:00:35.915433 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915420    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="be994ad2-5ec5-42fa-9141-138de3932f76" containerName="istio-proxy"
Oct 30 04:00:35.915468 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.915436    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="994b3360-da30-408a-baad-b01ed9def450" containerName="main"
Oct 30 04:00:35.920180 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.920151    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:35.938874 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.938850    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:00:35.948658 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.948635    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-bhhrm\""
Oct 30 04:00:35.950615 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.950561    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"default-dockercfg-b4mk4\""
Oct 30 04:00:35.950714 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.950567    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Oct 30 04:00:35.973750 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.973729    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"openshift-service-ca.crt\""
Oct 30 04:00:35.974032 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.974008    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"kube-root-ca.crt\""
Oct 30 04:00:35.985434 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.985407    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6bl\" (UniqueName: \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:35.985524 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:35.985455    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.086035 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.086004    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6bl\" (UniqueName: \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.086178 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.086049    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.090752 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.090721    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.111819 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.111787    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6bl\" (UniqueName: \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.234037 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.234010    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:36.535914 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:36.535887    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:00:36.537538 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:00:36.537503    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6f10ef_e543_483e_81aa_0fd6c5688e30.slice/crio-99b967156c0abf5e9f6d17ab740c5ca47809ef5efe8b3c6b3a30b9ba213839b8 WatchSource:0}: Error finding container 99b967156c0abf5e9f6d17ab740c5ca47809ef5efe8b3c6b3a30b9ba213839b8: Status 404 returned error can't find the container with id 99b967156c0abf5e9f6d17ab740c5ca47809ef5efe8b3c6b3a30b9ba213839b8
Oct 30 04:00:37.471166 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:37.471121    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" event={"ID":"9e6f10ef-e543-483e-81aa-0fd6c5688e30","Type":"ContainerStarted","Data":"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"}
Oct 30 04:00:37.471573 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:37.471182    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" event={"ID":"9e6f10ef-e543-483e-81aa-0fd6c5688e30","Type":"ContainerStarted","Data":"99b967156c0abf5e9f6d17ab740c5ca47809ef5efe8b3c6b3a30b9ba213839b8"}
Oct 30 04:00:37.471573 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:37.471240    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:00:37.517694 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:00:37.517647    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podStartSLOduration=2.517634595 podStartE2EDuration="2.517634595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:00:37.516095817 +0000 UTC m=+3906.837675537" watchObservedRunningTime="2026-10-30 04:00:37.517634595 +0000 UTC m=+3906.839214354"
Oct 30 04:00:57.820469 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:00:57.820431    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:01:08.478151 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:01:08.478120    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:01:27.819434 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:01:27.819398    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:01:57.820461 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:01:57.820424    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:02:27.819972 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:02:27.819936    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:02:57.819730 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:02:57.819692    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:02:58.692430 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:02:58.692388    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:03:08.478317 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:08.478275    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:03:13.713325 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:13.713260    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main" containerID="cri-o://4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e" gracePeriod=45
Oct 30 04:03:18.478529 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:18.478486    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:03:27.819685 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:03:27.819643    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:03:28.478441 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:28.478405    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:03:28.478625 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:28.478534    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:03:38.478637 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:38.478597    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:03:43.966153 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:43.966125    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:03:44.085462 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.085395    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\" (UniqueName: \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\") pod \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") "
Oct 30 04:03:44.085608 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.085474    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\") pod \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\" (UID: \"9e6f10ef-e543-483e-81aa-0fd6c5688e30\") "
Oct 30 04:03:44.087679 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.087653    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs" pod "9e6f10ef-e543-483e-81aa-0fd6c5688e30" (UID: "9e6f10ef-e543-483e-81aa-0fd6c5688e30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:03:44.087759 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.087680    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl" pod "9e6f10ef-e543-483e-81aa-0fd6c5688e30" (UID: "9e6f10ef-e543-483e-81aa-0fd6c5688e30"). InnerVolumeSpecName "kube-api-access-4b6bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:03:44.186125 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.186100    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6bl\" (UniqueName: \"kubernetes.io/projected/9e6f10ef-e543-483e-81aa-0fd6c5688e30-kube-api-access-4b6bl\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:03:44.186125 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.186121    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6f10ef-e543-483e-81aa-0fd6c5688e30-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:03:44.417114 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.417051    4869 generic.go:356] "Generic (PLEG): container finished" podID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerID="4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e" exitCode=0
Oct 30 04:03:44.417114 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.417103    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"
Oct 30 04:03:44.417253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.417139    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" event={"ID":"9e6f10ef-e543-483e-81aa-0fd6c5688e30","Type":"ContainerDied","Data":"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"}
Oct 30 04:03:44.417253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.417200    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj" event={"ID":"9e6f10ef-e543-483e-81aa-0fd6c5688e30","Type":"ContainerDied","Data":"99b967156c0abf5e9f6d17ab740c5ca47809ef5efe8b3c6b3a30b9ba213839b8"}
Oct 30 04:03:44.417253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.417230    4869 scope.go:122] "RemoveContainer" containerID="4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"
Oct 30 04:03:44.426490 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.426472    4869 scope.go:122] "RemoveContainer" containerID="4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"
Oct 30 04:03:44.426869 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:03:44.426852    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e\": container with ID starting with 4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e not found: ID does not exist" containerID="4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"
Oct 30 04:03:44.426926 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.426878    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e"} err="failed to get container status \"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e\": rpc error: code = NotFound desc = could not find container \"4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e\": container with ID starting with 4d466d23a8d6b6fc0f3435cef98c7de0b036c46aaf735b1b66df6a3b29e7727e not found: ID does not exist"
Oct 30 04:03:44.467429 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.467406    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:03:44.479014 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.478995    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-76c95s2pnj"]
Oct 30 04:03:44.819208 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:03:44.819177    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" path="/var/lib/kubelet/pods/9e6f10ef-e543-483e-81aa-0fd6c5688e30/volumes"
Oct 30 04:03:57.819740 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:03:57.819706    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:04:05.943956 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.943912    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:04:05.944619 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.944570    4869 cpu_manager.go:414] "containerMap: removing container" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main"
Oct 30 04:04:05.944741 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.944625    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main"
Oct 30 04:04:05.944798 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.944752    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e6f10ef-e543-483e-81aa-0fd6c5688e30" containerName="main"
Oct 30 04:04:05.949336 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.949313    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:05.954926 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.954896    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjsnr\" (UniqueName: \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:05.955044 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.954954    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:05.983990 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.983957    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"kube-root-ca.crt\""
Oct 30 04:04:05.984277 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.984261    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-service-ca.crt\""
Oct 30 04:04:05.984503 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.984487    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-epp-sa-dockercfg-nzcht\""
Oct 30 04:04:05.984750 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.984735    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
Oct 30 04:04:05.984959 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:05.984945    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"default-dockercfg-jmw65\""
Oct 30 04:04:06.002328 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.002291    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:04:06.056428 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.056399    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjsnr\" (UniqueName: \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:06.056600 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.056440    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:06.058997 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.058972    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:06.105153 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.105115    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjsnr\" (UniqueName: \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:06.262090 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.262010    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:06.592650 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:06.591218    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:04:06.603618 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:04:06.602461    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b1235e_e816_4e26_b9c4_c623ca2f60c4.slice/crio-9a780058b8e207027b5119ba9184e9fbff4e56ddd9f2dbc81db17e392251eef1 WatchSource:0}: Error finding container 9a780058b8e207027b5119ba9184e9fbff4e56ddd9f2dbc81db17e392251eef1: Status 404 returned error can't find the container with id 9a780058b8e207027b5119ba9184e9fbff4e56ddd9f2dbc81db17e392251eef1
Oct 30 04:04:07.539939 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:07.539902    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" event={"ID":"58b1235e-e816-4e26-b9c4-c623ca2f60c4","Type":"ContainerStarted","Data":"36c29c49daa47f5cfedd015d87eb9e52aa480a06916092210e3cecb93a5f1dd3"}
Oct 30 04:04:07.540374 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:07.539958    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" event={"ID":"58b1235e-e816-4e26-b9c4-c623ca2f60c4","Type":"ContainerStarted","Data":"9a780058b8e207027b5119ba9184e9fbff4e56ddd9f2dbc81db17e392251eef1"}
Oct 30 04:04:07.540374 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:07.540003    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:07.615702 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:07.615647    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podStartSLOduration=2.615630355 podStartE2EDuration="2.615630355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:04:07.613127953 +0000 UTC m=+4116.934707674" watchObservedRunningTime="2026-10-30 04:04:07.615630355 +0000 UTC m=+4116.937210052"
Oct 30 04:04:27.819723 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:04:27.819683    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:04:38.548337 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:04:38.548298    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:04:57.819744 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:04:57.819709    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:05:06.613455 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.613415    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"]
Oct 30 04:05:06.617013 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.616992    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.648075 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.648042    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"]
Oct 30 04:05:06.745191 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745156    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745335 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745197    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efdea12c-a38d-4bf1-942d-343574781453-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745335 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745221    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6bh8\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-kube-api-access-f6bh8\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745335 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745321    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745497 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745368    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745497 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745398    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745497 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745443    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745657 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745564    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efdea12c-a38d-4bf1-942d-343574781453-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.745657 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.745611    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.846895 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.846864    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847031 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.846901    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efdea12c-a38d-4bf1-942d-343574781453-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847031 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.846932    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6bh8\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-kube-api-access-f6bh8\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847031 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.846960    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847031 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847008    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847145    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847182    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847221    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efdea12c-a38d-4bf1-942d-343574781453-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847411 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847257    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847411 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847294    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847411 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847388    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847564 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847500    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847652 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847617    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.847766 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.847746    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efdea12c-a38d-4bf1-942d-343574781453-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.849255 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.849237    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efdea12c-a38d-4bf1-942d-343574781453-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.849569 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.849550    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efdea12c-a38d-4bf1-942d-343574781453-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.869527 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.869471    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.869711 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.869693    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6bh8\" (UniqueName: \"kubernetes.io/projected/efdea12c-a38d-4bf1-942d-343574781453-kube-api-access-f6bh8\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft\" (UID: \"efdea12c-a38d-4bf1-942d-343574781453\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:06.933489 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:06.933466    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:07.245678 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.245652    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"]
Oct 30 04:05:07.247330 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:05:07.247305    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdea12c_a38d_4bf1_942d_343574781453.slice/crio-192f28abfa82fc8aca40a62d51f5b859bdae4017f12e3fc135789047e9fdd403 WatchSource:0}: Error finding container 192f28abfa82fc8aca40a62d51f5b859bdae4017f12e3fc135789047e9fdd403: Status 404 returned error can't find the container with id 192f28abfa82fc8aca40a62d51f5b859bdae4017f12e3fc135789047e9fdd403
Oct 30 04:05:07.249325 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.249293    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:05:07.249414 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.249354    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:05:07.249414 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.249383    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:05:07.846646 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.846596    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" event={"ID":"efdea12c-a38d-4bf1-942d-343574781453","Type":"ContainerStarted","Data":"501b0876c7851456b2b2ce6ad04db4a3bb6962d0609fa40259c08bb73f245304"}
Oct 30 04:05:07.847060 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.846688    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" event={"ID":"efdea12c-a38d-4bf1-942d-343574781453","Type":"ContainerStarted","Data":"192f28abfa82fc8aca40a62d51f5b859bdae4017f12e3fc135789047e9fdd403"}
Oct 30 04:05:07.904373 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.904313    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podStartSLOduration=1.904296862 podStartE2EDuration="1.904296862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:05:07.902480003 +0000 UTC m=+4177.224059724" watchObservedRunningTime="2026-10-30 04:05:07.904296862 +0000 UTC m=+4177.225876580"
Oct 30 04:05:07.934558 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:07.934513    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:08.935505 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:08.935471    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 04:05:08.935930 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:08.935524    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podUID="efdea12c-a38d-4bf1-942d-343574781453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 04:05:09.934403 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:09.934367    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 04:05:09.934692 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:09.934423    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podUID="efdea12c-a38d-4bf1-942d-343574781453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 04:05:10.934711 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:10.934674    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 04:05:10.935112 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:10.934726    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podUID="efdea12c-a38d-4bf1-942d-343574781453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 04:05:11.933840 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:11.933803    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 04:05:11.934020 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:11.933868    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podUID="efdea12c-a38d-4bf1-942d-343574781453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 04:05:12.934094 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:12.934061    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 04:05:12.934495 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:12.934121    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft" podUID="efdea12c-a38d-4bf1-942d-343574781453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 04:05:13.938226 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:13.938189    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:13.938744 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:13.938608    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:13.939306 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:13.939279    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft"
Oct 30 04:05:27.820271 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:05:27.820225    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:05:31.285354 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:31.285240    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:05:31.299194 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:05:31.299172    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:05:57.819743 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:05:57.819709    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:06:27.819880 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:06:27.819837    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:06:56.417145 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:06:56.417109    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:06:57.820527 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:06:57.820491    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:06:58.548214 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:06:58.548170    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:07:08.547720 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:08.547679    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:07:11.443278 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:11.443218    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" containerID="cri-o://36c29c49daa47f5cfedd015d87eb9e52aa480a06916092210e3cecb93a5f1dd3" gracePeriod=45
Oct 30 04:07:18.548545 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:18.548500    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:07:18.548994 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:18.548640    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:07:27.847944 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:07:27.847880    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:07:28.548036 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:28.547995    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:07:37.033481 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.033447    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:07:37.037018 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.036996    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.068492 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.068468    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:07:37.077411 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077347    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077535 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077451    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077535 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077511    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077535 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077528    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbxm\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077712 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077553    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077848 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077825    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077899 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077887    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077946 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077909    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.077992 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.077970    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179127 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179096    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179266 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179153    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179266 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179177    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179266 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179202    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179266 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179226    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbxm\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179266 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179263    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179546 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179325    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179546 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179388    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179546 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179421    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179841 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179781    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.179841 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.179799    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.180114 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.180091    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.180161 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.180138    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.180320 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.180300    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.181627 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.181601    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.182144 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.182124    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.201283 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.201254    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.201650 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.201627    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbxm\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.351140 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.351084    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:37.663988 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.663963    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:07:37.665477 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:07:37.665452    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1c559f_c863_4813_82c2_629476a77efa.slice/crio-5d01e630e78f5a67bdd1ed47938609fad5179478ebfc9f294641d1b1a039ee6b WatchSource:0}: Error finding container 5d01e630e78f5a67bdd1ed47938609fad5179478ebfc9f294641d1b1a039ee6b: Status 404 returned error can't find the container with id 5d01e630e78f5a67bdd1ed47938609fad5179478ebfc9f294641d1b1a039ee6b
Oct 30 04:07:37.667486 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.667455    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:07:37.667542 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.667520    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:07:37.667597 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:37.667551    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:07:38.547657 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:38.547618    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:07:38.665681 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:38.665645    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" event={"ID":"7f1c559f-c863-4813-82c2-629476a77efa","Type":"ContainerStarted","Data":"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"}
Oct 30 04:07:38.665870 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:38.665702    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" event={"ID":"7f1c559f-c863-4813-82c2-629476a77efa","Type":"ContainerStarted","Data":"5d01e630e78f5a67bdd1ed47938609fad5179478ebfc9f294641d1b1a039ee6b"}
Oct 30 04:07:38.739215 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:38.739152    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podStartSLOduration=1.739137715 podStartE2EDuration="1.739137715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:07:38.727223349 +0000 UTC m=+4328.048803067" watchObservedRunningTime="2026-10-30 04:07:38.739137715 +0000 UTC m=+4328.060717433"
Oct 30 04:07:39.351752 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:39.351712    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:39.353354 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:39.353331    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 04:07:39.353483 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:39.353373    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 04:07:40.352057 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:40.352027    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 04:07:40.352440 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:40.352084    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 04:07:41.352348 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.352315    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 04:07:41.352758 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.352365    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 04:07:41.711271 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.711239    4869 generic.go:356] "Generic (PLEG): container finished" podID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerID="36c29c49daa47f5cfedd015d87eb9e52aa480a06916092210e3cecb93a5f1dd3" exitCode=0
Oct 30 04:07:41.711450 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.711292    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" event={"ID":"58b1235e-e816-4e26-b9c4-c623ca2f60c4","Type":"ContainerDied","Data":"36c29c49daa47f5cfedd015d87eb9e52aa480a06916092210e3cecb93a5f1dd3"}
Oct 30 04:07:41.755675 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.755651    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:07:41.827801 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.827769    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\") pod \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") "
Oct 30 04:07:41.827970 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.827830    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\" (UniqueName: \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\") pod \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\" (UID: \"58b1235e-e816-4e26-b9c4-c623ca2f60c4\") "
Oct 30 04:07:41.829974 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.829947    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs" pod "58b1235e-e816-4e26-b9c4-c623ca2f60c4" (UID: "58b1235e-e816-4e26-b9c4-c623ca2f60c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:07:41.830078 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.830033    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr" pod "58b1235e-e816-4e26-b9c4-c623ca2f60c4" (UID: "58b1235e-e816-4e26-b9c4-c623ca2f60c4"). InnerVolumeSpecName "kube-api-access-kjsnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:07:41.928746 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.928684    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjsnr\" (UniqueName: \"kubernetes.io/projected/58b1235e-e816-4e26-b9c4-c623ca2f60c4-kube-api-access-kjsnr\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:07:41.928746 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:41.928709    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b1235e-e816-4e26-b9c4-c623ca2f60c4-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:07:42.351996 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.351963    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 04:07:42.352166 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.352012    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 04:07:42.718327 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.718291    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj" event={"ID":"58b1235e-e816-4e26-b9c4-c623ca2f60c4","Type":"ContainerDied","Data":"9a780058b8e207027b5119ba9184e9fbff4e56ddd9f2dbc81db17e392251eef1"}
Oct 30 04:07:42.718760 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.718332    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"
Oct 30 04:07:42.718760 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.718390    4869 scope.go:122] "RemoveContainer" containerID="36c29c49daa47f5cfedd015d87eb9e52aa480a06916092210e3cecb93a5f1dd3"
Oct 30 04:07:42.783606 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.769048    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:07:42.787474 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.787448    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-6988f9c7dpsdmj"]
Oct 30 04:07:42.820225 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:42.820197    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" path="/var/lib/kubelet/pods/58b1235e-e816-4e26-b9c4-c623ca2f60c4/volumes"
Oct 30 04:07:43.351991 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:43.351952    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 04:07:43.352162 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:43.352004    4869 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 04:07:44.355025 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:44.354991    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:44.355466 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:44.355383    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:44.356027 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:07:44.356007    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:07:57.820716 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:07:57.820675    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:08:27.820396 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:08:27.820359    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:08:57.819070 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:08:57.819032    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:09:27.820820 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:09:27.820775    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:09:57.820090 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:09:57.820048    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:10:27.820092 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:10:27.820049    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:10:31.321030 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:31.320915    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:10:31.334571 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:31.334539    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:10:32.366078 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.366047    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:10:32.366473 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.366453    4869 cpu_manager.go:414] "containerMap: removing container" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main"
Oct 30 04:10:32.366473 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.366465    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main"
Oct 30 04:10:32.366560 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.366550    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="58b1235e-e816-4e26-b9c4-c623ca2f60c4" containerName="main"
Oct 30 04:10:32.374843 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.374816    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.392604 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.392554    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:10:32.400090 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.400059    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"default-dockercfg-b9z9s\""
Oct 30 04:10:32.400249 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.400213    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa-dockercfg-rljc5\""
Oct 30 04:10:32.404332 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.404304    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"kube-root-ca.crt\""
Oct 30 04:10:32.404442 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.404297    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"openshift-service-ca.crt\""
Oct 30 04:10:32.404442 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.404315    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Oct 30 04:10:32.454497 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.454467    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlx9p\" (UniqueName: \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.454637 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.454619    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.556095 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.556049    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.556405 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.556381    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlx9p\" (UniqueName: \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.559995 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.559963    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.588330 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.588289    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlx9p\" (UniqueName: \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.695467 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.695435    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:32.997415 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:32.997385    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:10:32.999135 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:10:32.999099    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f618b33_5290_47b3_af37_55577f28cb4e.slice/crio-15da39305659ff8d56ab87b2b7a0e6e35c9a8546914643c6789733a8fb69b6b4 WatchSource:0}: Error finding container 15da39305659ff8d56ab87b2b7a0e6e35c9a8546914643c6789733a8fb69b6b4: Status 404 returned error can't find the container with id 15da39305659ff8d56ab87b2b7a0e6e35c9a8546914643c6789733a8fb69b6b4
Oct 30 04:10:33.618414 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:33.618381    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" event={"ID":"5f618b33-5290-47b3-af37-55577f28cb4e","Type":"ContainerStarted","Data":"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"}
Oct 30 04:10:33.618826 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:33.618438    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" event={"ID":"5f618b33-5290-47b3-af37-55577f28cb4e","Type":"ContainerStarted","Data":"15da39305659ff8d56ab87b2b7a0e6e35c9a8546914643c6789733a8fb69b6b4"}
Oct 30 04:10:33.618826 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:33.618463    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:10:33.661284 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:33.661233    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podStartSLOduration=1.661220478 podStartE2EDuration="1.661220478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:10:33.659399219 +0000 UTC m=+4502.980978938" watchObservedRunningTime="2026-10-30 04:10:33.661220478 +0000 UTC m=+4502.982800196"
Oct 30 04:10:52.324211 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.324174    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:10:52.327831 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.327803    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.355489 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.355189    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"kube-root-ca.crt\""
Oct 30 04:10:52.355489 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.355212    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"openshift-service-ca.crt\""
Oct 30 04:10:52.358304 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.358280    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"default-dockercfg-cfqbt\""
Oct 30 04:10:52.358478 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.358383    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-model-based-routing-only-fae765e6\"/\"model-routing-only-7aad4d71-kserve-self-signed-certs\""
Oct 30 04:10:52.358947 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.358921    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:10:52.418897 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.418865    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhlqg\" (UniqueName: \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.419015 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.418915    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.419058 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.419018    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.419058 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.419046    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.419141 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.419065    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.419141 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.419118    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520011 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.519975    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520189 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520038    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520189 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520059    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520189 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520074    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520189 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520098    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520189 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520137    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhlqg\" (UniqueName: \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520464 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520423    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520464 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520446    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.520572 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.520503    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.522361 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.522339    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.522656 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.522640    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.542433 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.542409    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhlqg\" (UniqueName: \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\") pod \"model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") " pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.644418 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.644339    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:52.946406 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.946369    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:10:52.954991 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:10:52.954957    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca64eae_d0cd_48a8_ab47_18b47f6c71d7.slice/crio-7cc58cf733bf71f20b726d626fe085f8986e7089d0d4a27f1cb6e457b1d6679b WatchSource:0}: Error finding container 7cc58cf733bf71f20b726d626fe085f8986e7089d0d4a27f1cb6e457b1d6679b: Status 404 returned error can't find the container with id 7cc58cf733bf71f20b726d626fe085f8986e7089d0d4a27f1cb6e457b1d6679b
Oct 30 04:10:52.957275 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:52.957250    4869 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 04:10:53.731034 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:53.730992    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" event={"ID":"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7","Type":"ContainerStarted","Data":"7cc58cf733bf71f20b726d626fe085f8986e7089d0d4a27f1cb6e457b1d6679b"}
Oct 30 04:10:55.743187 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:55.743144    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" event={"ID":"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7","Type":"ContainerStarted","Data":"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"}
Oct 30 04:10:55.789848 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:55.788953    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" podStartSLOduration=2.005363911 podStartE2EDuration="3.788935958s" totalImagesPullingTime="1.783572047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:10:55.783531446 +0000 UTC m=+4525.105111174" watchObservedRunningTime="2026-10-30 04:10:55.788935958 +0000 UTC m=+4525.110515688"
Oct 30 04:10:56.645124 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:10:56.645081    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:10:57.819901 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:10:57.819867    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:11:02.645002 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:11:02.644965    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:11:02.657901 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:11:02.657874    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:11:02.788361 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:11:02.788334    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:11:04.625399 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:11:04.625364    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:11:27.819988 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:11:27.819954    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:11:57.819547 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:11:57.819506    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:12:13.337005 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.336970    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:12:13.346272 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:12:13.346230    4869 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" containerID="9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b" cmd=["/bin/sleep","15"]
Oct 30 04:12:13.346459 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.346296    4869 handlers.go:85] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" message="" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1"
Oct 30 04:12:13.346459 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:12:13.346315    4869 kuberuntime_container.go:780] "PreStop hook failed" err="rpc error: code = Unknown desc = command error: , stdout: , stderr: , exit code -1" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerName="main" containerID="cri-o://9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"
Oct 30 04:12:13.346459 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.346375    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerName="main" containerID="cri-o://9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b" gracePeriod=60
Oct 30 04:12:13.612187 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.612157    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:12:13.615964 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.615936    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.630403 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.630372    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:12:13.633431 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.633388    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"tls-verification-test-kserve-self-signed-certs\""
Oct 30 04:12:13.636716 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.635835    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"default-dockercfg-qshzj\""
Oct 30 04:12:13.636716 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.636188    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"openshift-service-ca.crt\""
Oct 30 04:12:13.637082 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.637056    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:12:13.639740 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.639716    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"kube-root-ca.crt\""
Oct 30 04:12:13.644747 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.644722    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-e4cad0c3\"/\"tls-verification-test-epp-sa-dockercfg-rth4s\""
Oct 30 04:12:13.661486 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661460    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661609 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661556    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661676 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661648    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661716 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661704    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661771 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661743    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:12:13.661823 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661761    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661884 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661830    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\" (UniqueName: \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\") pod \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\" (UID: \"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7\") "
Oct 30 04:12:13.661978 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.661905    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:12:13.662039 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662001    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:12:13.662100 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662062    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.662193 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662168    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9pj\" (UniqueName: \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.662351 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662334    4869 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.662420 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662357    4869 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.662420 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.662372    4869 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.664315 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.664286    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:12:13.664422 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.664346    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "kube-api-access-qhlqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:13.664422 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.664373    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs" pod "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" (UID: "2ca64eae-d0cd-48a8-ab47-18b47f6c71d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:13.763646 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.763601    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9pj\" (UniqueName: \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.763835 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.763698    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.763835 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.763764    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.763835 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.763779    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhlqg\" (UniqueName: \"kubernetes.io/projected/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-kube-api-access-qhlqg\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.763835 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.763790    4869 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:13.766346 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.766319    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.786211 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.786180    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9pj\" (UniqueName: \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\") pod \"tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") " pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:13.946883 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:13.946849    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:14.147792 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.147751    4869 generic.go:356] "Generic (PLEG): container finished" podID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerID="9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b" exitCode=0
Oct 30 04:12:14.147983 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.147796    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"
Oct 30 04:12:14.147983 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.147838    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" event={"ID":"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7","Type":"ContainerDied","Data":"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"}
Oct 30 04:12:14.147983 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.147900    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8" event={"ID":"2ca64eae-d0cd-48a8-ab47-18b47f6c71d7","Type":"ContainerDied","Data":"7cc58cf733bf71f20b726d626fe085f8986e7089d0d4a27f1cb6e457b1d6679b"}
Oct 30 04:12:14.147983 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.147926    4869 scope.go:122] "RemoveContainer" containerID="9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"
Oct 30 04:12:14.163606 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.163572    4869 scope.go:122] "RemoveContainer" containerID="9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"
Oct 30 04:12:14.163972 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:12:14.163950    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b\": container with ID starting with 9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b not found: ID does not exist" containerID="9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"
Oct 30 04:12:14.164045 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.163979    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b"} err="failed to get container status \"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b\": rpc error: code = NotFound desc = could not find container \"9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b\": container with ID starting with 9537a7874681d4bab11b1ed81b8bbc7a6bff8afb238be057932497358d50244b not found: ID does not exist"
Oct 30 04:12:14.197504 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.197445    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:12:14.201853 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.201828    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-model-based-routing-only-fae765e6/model-routing-only-7aad4d71-kserve-6557db66dd-qpgq8"]
Oct 30 04:12:14.244742 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.244722    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:12:14.246871 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:12:14.246844    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4464eca2_ac8d_496c_85ee_2eaa09a3ed26.slice/crio-d0130eaba5074795a3fe539e01c407c5b9a32b78a5b783344e9afdc6c2327ddc WatchSource:0}: Error finding container d0130eaba5074795a3fe539e01c407c5b9a32b78a5b783344e9afdc6c2327ddc: Status 404 returned error can't find the container with id d0130eaba5074795a3fe539e01c407c5b9a32b78a5b783344e9afdc6c2327ddc
Oct 30 04:12:14.819081 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:14.819046    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" path="/var/lib/kubelet/pods/2ca64eae-d0cd-48a8-ab47-18b47f6c71d7/volumes"
Oct 30 04:12:15.155272 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:15.155176    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" event={"ID":"4464eca2-ac8d-496c-85ee-2eaa09a3ed26","Type":"ContainerStarted","Data":"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"}
Oct 30 04:12:15.155272 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:15.155247    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" event={"ID":"4464eca2-ac8d-496c-85ee-2eaa09a3ed26","Type":"ContainerStarted","Data":"d0130eaba5074795a3fe539e01c407c5b9a32b78a5b783344e9afdc6c2327ddc"}
Oct 30 04:12:15.155485 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:15.155285    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:15.196843 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:15.196792    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podStartSLOduration=2.196774469 podStartE2EDuration="2.196774469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:12:15.194053534 +0000 UTC m=+4604.515633254" watchObservedRunningTime="2026-10-30 04:12:15.196774469 +0000 UTC m=+4604.518354189"
Oct 30 04:12:19.748416 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:19.748376    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:12:24.625151 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:24.625111    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:12:27.820752 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:12:27.820716    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:12:34.625236 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:34.625188    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:12:34.769226 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:34.769155    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" containerID="cri-o://1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015" gracePeriod=45
Oct 30 04:12:44.624868 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:44.624778    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:12:44.625354 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:44.624917    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:12:46.171116 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:46.171087    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:12:54.624908 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:12:54.624874    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:12:57.819267 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:12:57.819225    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:13:04.625296 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:04.625259    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:13:05.026506 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.026481    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:13:05.065468 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.065436    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\" (UniqueName: \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\") pod \"5f618b33-5290-47b3-af37-55577f28cb4e\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") "
Oct 30 04:13:05.065609 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.065496    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\") pod \"5f618b33-5290-47b3-af37-55577f28cb4e\" (UID: \"5f618b33-5290-47b3-af37-55577f28cb4e\") "
Oct 30 04:13:05.067891 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.067861    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs" pod "5f618b33-5290-47b3-af37-55577f28cb4e" (UID: "5f618b33-5290-47b3-af37-55577f28cb4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:13:05.068023 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.067869    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p" pod "5f618b33-5290-47b3-af37-55577f28cb4e" (UID: "5f618b33-5290-47b3-af37-55577f28cb4e"). InnerVolumeSpecName "kube-api-access-qlx9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:13:05.166936 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.166881    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlx9p\" (UniqueName: \"kubernetes.io/projected/5f618b33-5290-47b3-af37-55577f28cb4e-kube-api-access-qlx9p\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:05.166936 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.166904    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f618b33-5290-47b3-af37-55577f28cb4e-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:05.428070 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.428010    4869 generic.go:356] "Generic (PLEG): container finished" podID="5f618b33-5290-47b3-af37-55577f28cb4e" containerID="1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015" exitCode=0
Oct 30 04:13:05.428070 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.428054    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"
Oct 30 04:13:05.428253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.428100    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" event={"ID":"5f618b33-5290-47b3-af37-55577f28cb4e","Type":"ContainerDied","Data":"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"}
Oct 30 04:13:05.428253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.428167    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7" event={"ID":"5f618b33-5290-47b3-af37-55577f28cb4e","Type":"ContainerDied","Data":"15da39305659ff8d56ab87b2b7a0e6e35c9a8546914643c6789733a8fb69b6b4"}
Oct 30 04:13:05.428253 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.428198    4869 scope.go:122] "RemoveContainer" containerID="1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"
Oct 30 04:13:05.437939 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.437916    4869 scope.go:122] "RemoveContainer" containerID="1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"
Oct 30 04:13:05.438234 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:13:05.438213    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015\": container with ID starting with 1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015 not found: ID does not exist" containerID="1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"
Oct 30 04:13:05.438286 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.438242    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015"} err="failed to get container status \"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015\": rpc error: code = NotFound desc = could not find container \"1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015\": container with ID starting with 1ac90de08ebdd922f941d59c9883d32ce8ebb3499504bf0304a0169cb6ba1015 not found: ID does not exist"
Oct 30 04:13:05.478357 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.478335    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:13:05.490136 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:05.490115    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegtpl7"]
Oct 30 04:13:06.819487 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:06.819451    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" path="/var/lib/kubelet/pods/5f618b33-5290-47b3-af37-55577f28cb4e/volumes"
Oct 30 04:13:16.205025 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.204989    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:13:16.205551 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205391    4869 cpu_manager.go:414] "containerMap: removing container" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main"
Oct 30 04:13:16.205551 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205402    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main"
Oct 30 04:13:16.205551 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205415    4869 cpu_manager.go:414] "containerMap: removing container" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerName="main"
Oct 30 04:13:16.205551 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205423    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerName="main"
Oct 30 04:13:16.205815 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205568    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f618b33-5290-47b3-af37-55577f28cb4e" containerName="main"
Oct 30 04:13:16.205815 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.205601    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ca64eae-d0cd-48a8-ab47-18b47f6c71d7" containerName="main"
Oct 30 04:13:16.208953 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.208933    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.230997 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.230974    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:13:16.239864 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.239839    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"openshift-service-ca.crt\""
Oct 30 04:13:16.239998 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.239900    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"kube-root-ca.crt\""
Oct 30 04:13:16.239998 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.239945    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"default-dockercfg-vcvsf\""
Oct 30 04:13:16.239998 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.239949    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-epp-sa-dockercfg-6hpdq\""
Oct 30 04:13:16.240134 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.240030    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-kserve-self-signed-certs\""
Oct 30 04:13:16.262320 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.262295    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fnd\" (UniqueName: \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.262441 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.262362    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.363330 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.363296    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fnd\" (UniqueName: \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.363472 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.363385    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.365916 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.365893    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.386247 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.386216    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fnd\" (UniqueName: \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\") pod \"prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.523950 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.523865    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:16.822015 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:16.821947    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:13:16.825307 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:13:16.825276    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa7bda4_b540_4551_b3fd_6a92697af64f.slice/crio-72761ea9c12ba267edc38e470371b9e26b6ea0b338ff287c7ac9d8a091cb0a84 WatchSource:0}: Error finding container 72761ea9c12ba267edc38e470371b9e26b6ea0b338ff287c7ac9d8a091cb0a84: Status 404 returned error can't find the container with id 72761ea9c12ba267edc38e470371b9e26b6ea0b338ff287c7ac9d8a091cb0a84
Oct 30 04:13:17.495922 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:17.495883    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" event={"ID":"faa7bda4-b540-4551-b3fd-6a92697af64f","Type":"ContainerStarted","Data":"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"}
Oct 30 04:13:17.496355 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:17.495969    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" event={"ID":"faa7bda4-b540-4551-b3fd-6a92697af64f","Type":"ContainerStarted","Data":"72761ea9c12ba267edc38e470371b9e26b6ea0b338ff287c7ac9d8a091cb0a84"}
Oct 30 04:13:17.496355 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:17.496010    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:17.536772 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:17.536725    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podStartSLOduration=1.53671222 podStartE2EDuration="1.53671222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:17.535233197 +0000 UTC m=+4666.856812916" watchObservedRunningTime="2026-10-30 04:13:17.53671222 +0000 UTC m=+4666.858291940"
Oct 30 04:13:27.820250 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:13:27.820217    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:13:48.504199 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:13:48.504163    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:13:57.820658 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:13:57.820623    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:14:27.819918 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:14:27.819885    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:14:57.819869 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:14:57.819833    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:15:27.820330 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:15:27.820291    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:15:31.356282 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:31.356176    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:15:31.376449 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:31.376427    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:15:35.374822 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:35.374784    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:15:38.504506 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:38.504468    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:15:48.504332 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:48.504234    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:15:50.395988 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:50.395931    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" containerID="cri-o://b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8" gracePeriod=45
Oct 30 04:15:57.820167 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:15:57.820130    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:15:58.503843 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:58.503810    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:15:58.504027 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:15:58.503906    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:16:08.504114 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:08.504074    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:16:18.503908 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:18.503864    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:16:20.652292 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.652235    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:16:20.825158 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.825130    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\" (UniqueName: \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\") pod \"faa7bda4-b540-4551-b3fd-6a92697af64f\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") "
Oct 30 04:16:20.825301 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.825172    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\" (UniqueName: \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\") pod \"faa7bda4-b540-4551-b3fd-6a92697af64f\" (UID: \"faa7bda4-b540-4551-b3fd-6a92697af64f\") "
Oct 30 04:16:20.827246 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.827219    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs" pod "faa7bda4-b540-4551-b3fd-6a92697af64f" (UID: "faa7bda4-b540-4551-b3fd-6a92697af64f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:20.827357 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.827283    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd" pod "faa7bda4-b540-4551-b3fd-6a92697af64f" (UID: "faa7bda4-b540-4551-b3fd-6a92697af64f"). InnerVolumeSpecName "kube-api-access-d9fnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:20.926561 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.926494    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa7bda4-b540-4551-b3fd-6a92697af64f-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:20.926561 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:20.926516    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9fnd\" (UniqueName: \"kubernetes.io/projected/faa7bda4-b540-4551-b3fd-6a92697af64f-kube-api-access-d9fnd\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:21.482642 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.482600    4869 generic.go:356] "Generic (PLEG): container finished" podID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerID="b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8" exitCode=0
Oct 30 04:16:21.482642 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.482636    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"
Oct 30 04:16:21.482844 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.482605    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" event={"ID":"faa7bda4-b540-4551-b3fd-6a92697af64f","Type":"ContainerDied","Data":"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"}
Oct 30 04:16:21.482844 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.482758    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6" event={"ID":"faa7bda4-b540-4551-b3fd-6a92697af64f","Type":"ContainerDied","Data":"72761ea9c12ba267edc38e470371b9e26b6ea0b338ff287c7ac9d8a091cb0a84"}
Oct 30 04:16:21.482844 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.482793    4869 scope.go:122] "RemoveContainer" containerID="b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"
Oct 30 04:16:21.493429 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.493124    4869 scope.go:122] "RemoveContainer" containerID="b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"
Oct 30 04:16:21.493564 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:16:21.493541    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8\": container with ID starting with b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8 not found: ID does not exist" containerID="b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"
Oct 30 04:16:21.493666 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.493594    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8"} err="failed to get container status \"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8\": rpc error: code = NotFound desc = could not find container \"b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8\": container with ID starting with b859b38fe368c0a57093c2fb156f850913d6124d09d69cfc223dbb90e45f83c8 not found: ID does not exist"
Oct 30 04:16:21.533859 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.533825    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:16:21.545828 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:21.545804    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-89ccd5fbb-wwgd6"]
Oct 30 04:16:22.818466 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:22.818430    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" path="/var/lib/kubelet/pods/faa7bda4-b540-4551-b3fd-6a92697af64f/volumes"
Oct 30 04:16:27.820145 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:16:27.820108    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:16:37.680729 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:37.680693    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:16:46.171163 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:46.171118    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:16:52.700955 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:52.700878    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main" containerID="cri-o://ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb" gracePeriod=45
Oct 30 04:16:56.171570 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:16:56.171524    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:16:57.819910 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:16:57.819876    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:17:06.170889 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:06.170854    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:17:06.171320 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:06.170966    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:17:16.171248 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:16.171154    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:17:22.955960 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:22.955930    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:17:23.122993 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.122927    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\" (UniqueName: \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\") pod \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") "
Oct 30 04:17:23.122993 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.122967    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\" (UniqueName: \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\") pod \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\" (UID: \"4464eca2-ac8d-496c-85ee-2eaa09a3ed26\") "
Oct 30 04:17:23.125136 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.125109    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs" pod "4464eca2-ac8d-496c-85ee-2eaa09a3ed26" (UID: "4464eca2-ac8d-496c-85ee-2eaa09a3ed26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:17:23.125243 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.125129    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj" pod "4464eca2-ac8d-496c-85ee-2eaa09a3ed26" (UID: "4464eca2-ac8d-496c-85ee-2eaa09a3ed26"). InnerVolumeSpecName "kube-api-access-7w9pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:23.224240 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.224216    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:23.224240 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.224238    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9pj\" (UniqueName: \"kubernetes.io/projected/4464eca2-ac8d-496c-85ee-2eaa09a3ed26-kube-api-access-7w9pj\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:23.820518 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.820487    4869 generic.go:356] "Generic (PLEG): container finished" podID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerID="ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb" exitCode=0
Oct 30 04:17:23.820774 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.820536    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"
Oct 30 04:17:23.820774 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.820596    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" event={"ID":"4464eca2-ac8d-496c-85ee-2eaa09a3ed26","Type":"ContainerDied","Data":"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"}
Oct 30 04:17:23.820774 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.820648    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj" event={"ID":"4464eca2-ac8d-496c-85ee-2eaa09a3ed26","Type":"ContainerDied","Data":"d0130eaba5074795a3fe539e01c407c5b9a32b78a5b783344e9afdc6c2327ddc"}
Oct 30 04:17:23.820774 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.820672    4869 scope.go:122] "RemoveContainer" containerID="ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"
Oct 30 04:17:23.839662 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.839638    4869 scope.go:122] "RemoveContainer" containerID="ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"
Oct 30 04:17:23.839980 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:17:23.839955    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb\": container with ID starting with ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb not found: ID does not exist" containerID="ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"
Oct 30 04:17:23.840063 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.839994    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb"} err="failed to get container status \"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb\": rpc error: code = NotFound desc = could not find container \"ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb\": container with ID starting with ab07882640a5cf0e0e934614f7a521e58b1d68b63c147e61d284cb0592ba63cb not found: ID does not exist"
Oct 30 04:17:23.873397 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.873371    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:17:23.884618 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:23.884594    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-tls-resources-e4cad0c3/tls-verification-test-kserve-router-scheduler-69f7c679f8-l8gjj"]
Oct 30 04:17:24.819944 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:24.819911    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" path="/var/lib/kubelet/pods/4464eca2-ac8d-496c-85ee-2eaa09a3ed26/volumes"
Oct 30 04:17:27.819848 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:17:27.819813    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:17:36.280983 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.280940    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:17:36.281960 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.281934    4869 cpu_manager.go:414] "containerMap: removing container" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main"
Oct 30 04:17:36.282103 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.281962    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main"
Oct 30 04:17:36.282103 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.282033    4869 cpu_manager.go:414] "containerMap: removing container" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main"
Oct 30 04:17:36.282103 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.282041    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main"
Oct 30 04:17:36.282341 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.282202    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="faa7bda4-b540-4551-b3fd-6a92697af64f" containerName="main"
Oct 30 04:17:36.282341 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.282218    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="4464eca2-ac8d-496c-85ee-2eaa09a3ed26" containerName="main"
Oct 30 04:17:36.288747 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.287764    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.306149 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.306116    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:17:36.314546 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.314521    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"openshift-service-ca.crt\""
Oct 30 04:17:36.314821 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.314795    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"kube-root-ca.crt\""
Oct 30 04:17:36.314996 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.314978    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"default-dockercfg-sgm5x\""
Oct 30 04:17:36.315068 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.314989    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Oct 30 04:17:36.315068 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.315028    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-epp-sa-dockercfg-n95xp\""
Oct 30 04:17:36.421664 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.421628    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28mc\" (UniqueName: \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.421818 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.421694    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.522503 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.522460    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28mc\" (UniqueName: \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.522703 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.522532    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.525289 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.525260    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.548053 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.547996    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28mc\" (UniqueName: \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\") pod \"rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.602775 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.602748    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:36.908159 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:36.908128    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:17:36.909237 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:17:36.909202    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805de359_6b23_4c34_ba33_7ab0172d0f95.slice/crio-5a1b468051b6b923e25e88f1c11d672715e30d4694f0188d27bd7dffea163dd8 WatchSource:0}: Error finding container 5a1b468051b6b923e25e88f1c11d672715e30d4694f0188d27bd7dffea163dd8: Status 404 returned error can't find the container with id 5a1b468051b6b923e25e88f1c11d672715e30d4694f0188d27bd7dffea163dd8
Oct 30 04:17:37.911608 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:37.911469    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" event={"ID":"805de359-6b23-4c34-ba33-7ab0172d0f95","Type":"ContainerStarted","Data":"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"}
Oct 30 04:17:37.911608 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:37.911543    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" event={"ID":"805de359-6b23-4c34-ba33-7ab0172d0f95","Type":"ContainerStarted","Data":"5a1b468051b6b923e25e88f1c11d672715e30d4694f0188d27bd7dffea163dd8"}
Oct 30 04:17:37.911608 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:37.911617    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:17:37.958984 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:37.958921    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podStartSLOduration=1.958900951 podStartE2EDuration="1.958900951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:17:37.956485716 +0000 UTC m=+4927.278065432" watchObservedRunningTime="2026-10-30 04:17:37.958900951 +0000 UTC m=+4927.280480671"
Oct 30 04:17:38.935596 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:38.934665    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:17:38.948599 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:38.937502    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" containerID="cri-o://d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa" gracePeriod=30
Oct 30 04:17:44.358203 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:44.358162    4869 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 04:17:44.358618 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:44.358234    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 04:17:48.618719 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.618695    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:17:48.694974 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.694944    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695121 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.694989    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695121 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695019    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695121 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695054    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695305 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695151    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695305 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695204    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695305 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695259    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695305 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695301    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695521 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695327    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\") pod \"7f1c559f-c863-4813-82c2-629476a77efa\" (UID: \"7f1c559f-c863-4813-82c2-629476a77efa\") "
Oct 30 04:17:48.695521 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695379    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:48.695521 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695507    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:48.695745 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695656    4869 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-credential-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.695745 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695676    4869 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-data\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.695852 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.695747    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:48.696024 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.696002    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:17:48.696099 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.696080    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:48.698765 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.697705    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 04:17:48.698765 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.697863    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:48.698765 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.697870    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:48.700075 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.700044    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm" pod "7f1c559f-c863-4813-82c2-629476a77efa" (UID: "7f1c559f-c863-4813-82c2-629476a77efa"). InnerVolumeSpecName "kube-api-access-rtbxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:48.796600 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796554    4869 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-socket\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796600 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796598    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtbxm\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-kube-api-access-rtbxm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796756 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796609    4869 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1c559f-c863-4813-82c2-629476a77efa-istio-podinfo\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796756 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796618    4869 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1c559f-c863-4813-82c2-629476a77efa-istiod-ca-cert\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796756 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796626    4869 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-workload-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796756 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796634    4869 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1c559f-c863-4813-82c2-629476a77efa-istio-envoy\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:48.796756 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:48.796641    4869 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1c559f-c863-4813-82c2-629476a77efa-istio-token\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:49.020606 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.020513    4869 generic.go:356] "Generic (PLEG): container finished" podID="7f1c559f-c863-4813-82c2-629476a77efa" containerID="d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa" exitCode=0
Oct 30 04:17:49.020606 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.020568    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"
Oct 30 04:17:49.020791 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.020611    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" event={"ID":"7f1c559f-c863-4813-82c2-629476a77efa","Type":"ContainerDied","Data":"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"}
Oct 30 04:17:49.020791 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.020669    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2" event={"ID":"7f1c559f-c863-4813-82c2-629476a77efa","Type":"ContainerDied","Data":"5d01e630e78f5a67bdd1ed47938609fad5179478ebfc9f294641d1b1a039ee6b"}
Oct 30 04:17:49.020791 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.020695    4869 scope.go:122] "RemoveContainer" containerID="d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"
Oct 30 04:17:49.029923 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.029896    4869 scope.go:122] "RemoveContainer" containerID="d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"
Oct 30 04:17:49.030175 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:17:49.030155    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa\": container with ID starting with d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa not found: ID does not exist" containerID="d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"
Oct 30 04:17:49.030224 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.030184    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa"} err="failed to get container status \"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa\": rpc error: code = NotFound desc = could not find container \"d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa\": container with ID starting with d4d28569762d4f329aad32bd6ae0990693b9200bb2c3f754f14afc39ee4696aa not found: ID does not exist"
Oct 30 04:17:49.072713 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.072690    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:17:49.076916 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:49.076894    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-9lbs2"]
Oct 30 04:17:50.819997 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:17:50.819965    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f1c559f-c863-4813-82c2-629476a77efa" path="/var/lib/kubelet/pods/7f1c559f-c863-4813-82c2-629476a77efa/volumes"
Oct 30 04:17:57.820026 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:17:57.819991    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:18:09.959426 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:09.959395    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:18:16.326750 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:16.326710    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:18:19.959069 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:19.959028    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:18:24.130701 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.130661    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"]
Oct 30 04:18:24.131246 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.131225    4869 cpu_manager.go:414] "containerMap: removing container" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy"
Oct 30 04:18:24.131330 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.131248    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy"
Oct 30 04:18:24.131427 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.131413    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f1c559f-c863-4813-82c2-629476a77efa" containerName="istio-proxy"
Oct 30 04:18:24.134600 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.134553    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.163779 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.163755    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"]
Oct 30 04:18:24.276301 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276264    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276461 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276309    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276461 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276371    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dfpk\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-kube-api-access-6dfpk\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276461 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276409    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276461 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276429    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276627 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276543    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce2b215-ba2a-4684-b910-bdb48267fd97-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276627 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276565    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276627 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276611    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.276722 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.276703    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378041 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378007    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378045    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378083    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce2b215-ba2a-4684-b910-bdb48267fd97-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378109    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378135    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378164    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378449 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378219    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378449 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378262    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378449 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378298    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dfpk\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-kube-api-access-6dfpk\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378682 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378656    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-data\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378765 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378686    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378827 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378781    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-credential-socket\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.378906 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.378886    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-workload-certs\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.379117 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.379099    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce2b215-ba2a-4684-b910-bdb48267fd97-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.380417 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.380397    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-envoy\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.380738 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.380692    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.401157 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.401133    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-istio-token\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.401236 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.401195    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dfpk\" (UniqueName: \"kubernetes.io/projected/5ce2b215-ba2a-4684-b910-bdb48267fd97-kube-api-access-6dfpk\") pod \"openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w\" (UID: \"5ce2b215-ba2a-4684-b910-bdb48267fd97\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.447182 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.447158    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:24.759398 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.759371    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"]
Oct 30 04:18:24.761431 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:18:24.761403    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce2b215_ba2a_4684_b910_bdb48267fd97.slice/crio-01bd6a02e0b47113b6830a7d7f28fe5eccdb49f5035b8b6ba1625f2b66a137dc WatchSource:0}: Error finding container 01bd6a02e0b47113b6830a7d7f28fe5eccdb49f5035b8b6ba1625f2b66a137dc: Status 404 returned error can't find the container with id 01bd6a02e0b47113b6830a7d7f28fe5eccdb49f5035b8b6ba1625f2b66a137dc
Oct 30 04:18:24.763594 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.763551    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:18:24.763690 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.763643    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:18:24.763690 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:24.763675    4869 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 04:18:25.218134 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:25.218099    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w" event={"ID":"5ce2b215-ba2a-4684-b910-bdb48267fd97","Type":"ContainerStarted","Data":"77d3c19dbe7b5766d7748047425c3b6a7af414fc26b112ea3be678d1783cdcd0"}
Oct 30 04:18:25.218636 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:25.218151    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w" event={"ID":"5ce2b215-ba2a-4684-b910-bdb48267fd97","Type":"ContainerStarted","Data":"01bd6a02e0b47113b6830a7d7f28fe5eccdb49f5035b8b6ba1625f2b66a137dc"}
Oct 30 04:18:25.275506 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:25.275455    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w" podStartSLOduration=1.275440559 podStartE2EDuration="1.275440559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:18:25.273293037 +0000 UTC m=+4974.594872755" watchObservedRunningTime="2026-10-30 04:18:25.275440559 +0000 UTC m=+4974.597020347"
Oct 30 04:18:25.447547 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:25.447520    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:25.452443 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:25.452420    4869 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:26.224004 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:26.223975    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:26.224768 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:26.224745    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w"
Oct 30 04:18:27.819873 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:18:27.819829    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:18:29.959436 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:29.959393    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:18:31.347333 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:31.347277    4869 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" containerID="cri-o://f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949" gracePeriod=45
Oct 30 04:18:39.959479 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:39.959435    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:18:39.959927 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:39.959565    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:18:49.958900 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:49.958811    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:18:57.820671 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:18:57.820635    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:18:59.958687 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:18:59.958649    4869 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 04:19:01.604842 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.604778    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:19:01.754817 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.754777    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\" (UniqueName: \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\") pod \"805de359-6b23-4c34-ba33-7ab0172d0f95\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") "
Oct 30 04:19:01.755013 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.754840    4869 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\" (UniqueName: \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\") pod \"805de359-6b23-4c34-ba33-7ab0172d0f95\" (UID: \"805de359-6b23-4c34-ba33-7ab0172d0f95\") "
Oct 30 04:19:01.757056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.757022    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs" pod "805de359-6b23-4c34-ba33-7ab0172d0f95" (UID: "805de359-6b23-4c34-ba33-7ab0172d0f95"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:19:01.757169 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.757062    4869 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc" pod "805de359-6b23-4c34-ba33-7ab0172d0f95" (UID: "805de359-6b23-4c34-ba33-7ab0172d0f95"). InnerVolumeSpecName "kube-api-access-b28mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:19:01.855734 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.855662    4869 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b28mc\" (UniqueName: \"kubernetes.io/projected/805de359-6b23-4c34-ba33-7ab0172d0f95-kube-api-access-b28mc\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:19:01.855734 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:01.855691    4869 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805de359-6b23-4c34-ba33-7ab0172d0f95-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\""
Oct 30 04:19:02.417208 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.417168    4869 generic.go:356] "Generic (PLEG): container finished" podID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerID="f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949" exitCode=0
Oct 30 04:19:02.417382 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.417219    4869 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"
Oct 30 04:19:02.417382 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.417225    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" event={"ID":"805de359-6b23-4c34-ba33-7ab0172d0f95","Type":"ContainerDied","Data":"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"}
Oct 30 04:19:02.417382 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.417343    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg" event={"ID":"805de359-6b23-4c34-ba33-7ab0172d0f95","Type":"ContainerDied","Data":"5a1b468051b6b923e25e88f1c11d672715e30d4694f0188d27bd7dffea163dd8"}
Oct 30 04:19:02.417382 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.417370    4869 scope.go:122] "RemoveContainer" containerID="f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"
Oct 30 04:19:02.426525 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.426506    4869 scope.go:122] "RemoveContainer" containerID="f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"
Oct 30 04:19:02.426795 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:19:02.426778    4869 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949\": container with ID starting with f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949 not found: ID does not exist" containerID="f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"
Oct 30 04:19:02.426857 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.426803    4869 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949"} err="failed to get container status \"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949\": rpc error: code = NotFound desc = could not find container \"f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949\": container with ID starting with f565006147cd3f109aafdab0ae7b134d5a91019fdf5dae66678c1f7fa9e29949 not found: ID does not exist"
Oct 30 04:19:02.467804 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.467782    4869 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:19:02.479431 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.479405    4869 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-7455cbc656-j72jg"]
Oct 30 04:19:02.818985 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:02.818949    4869 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" path="/var/lib/kubelet/pods/805de359-6b23-4c34-ba33-7ab0172d0f95/volumes"
Oct 30 04:19:27.820800 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:19:27.820761    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:19:44.071069 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:44.071037    4869 ???:1] "http: TLS handshake error from 10.0.136.202:43324: EOF"
Oct 30 04:19:44.306684 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:44.306651    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-l7g8g_8c198945-756e-4bd5-9fee-ae06c5e590b9/discovery/0.log"
Oct 30 04:19:44.344413 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:44.344346    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k_e76ada6b-6390-464d-80cf-d3634469236b/istio-proxy/0.log"
Oct 30 04:19:44.523386 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:44.523360    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w_5ce2b215-ba2a-4684-b910-bdb48267fd97/istio-proxy/0.log"
Oct 30 04:19:45.091484 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:45.091450    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft_efdea12c-a38d-4bf1-942d-343574781453/istio-proxy/0.log"
Oct 30 04:19:45.156233 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:45.156211    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8b5c987-q7zgf_2a895e88-4ff6-436e-9e50-dcff54933988/router/0.log"
Oct 30 04:19:46.852825 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:46.852795    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-l7g8g_8c198945-756e-4bd5-9fee-ae06c5e590b9/discovery/0.log"
Oct 30 04:19:46.894354 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:46.894330    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k_e76ada6b-6390-464d-80cf-d3634469236b/istio-proxy/0.log"
Oct 30 04:19:47.019353 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:47.019331    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w_5ce2b215-ba2a-4684-b910-bdb48267fd97/istio-proxy/0.log"
Oct 30 04:19:47.472868 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:47.472824    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft_efdea12c-a38d-4bf1-942d-343574781453/istio-proxy/0.log"
Oct 30 04:19:47.536227 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:47.536206    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8b5c987-q7zgf_2a895e88-4ff6-436e-9e50-dcff54933988/router/0.log"
Oct 30 04:19:49.107378 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:49.107343    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-68df894cb4-2qg98_12fa1ccf-4cb7-44a1-a375-ff6ea615da47/manager/0.log"
Oct 30 04:19:49.294801 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:49.294774    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-658c459c99-49k8w_ac689f53-d892-4d51-8976-84ce9966392f/manager/0.log"
Oct 30 04:19:49.390424 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:49.390360    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-69b7bb8c5c-vd7pn_8479926b-9133-4823-b552-0f31a2db5282/manager/0.log"
Oct 30 04:19:57.382874 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:57.382843    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l6fz8_fcd7fb7e-4ce4-44ec-8d4d-d4c753f8591a/global-pull-secret-syncer/0.log"
Oct 30 04:19:57.653268 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:57.653202    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-2g88s_dab5c412-1558-4d16-88c2-0b3f3dd21790/connection-checker/0.log"
Oct 30 04:19:57.775203 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:57.775174    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-gkprk_f5bb4192-b645-4e9e-8f49-1d1e546092aa/connection-checker/0.log"
Oct 30 04:19:57.819881 ip-10-0-136-202 kubenswrapper[4869]: E1030 04:19:57.819842    4869 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-qts9q" containerName="extractor"
Oct 30 04:19:57.894964 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:57.894934    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-hxlmq_ce98fed2-c56e-4d43-aba4-5e7173e0dbe2/connection-checker/0.log"
Oct 30 04:19:58.196027 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:58.195998    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k2fmn_ad3e816f-1810-4e16-9392-f393580c75b3/konnectivity-agent/0.log"
Oct 30 04:19:58.538457 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:19:58.538387    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-202.ec2.internal_13f55a681f1d4144d42dc77996364937/haproxy/0.log"
Oct 30 04:20:05.219050 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:05.219012    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-68df894cb4-2qg98_12fa1ccf-4cb7-44a1-a375-ff6ea615da47/manager/0.log"
Oct 30 04:20:05.544902 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:05.544817    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-658c459c99-49k8w_ac689f53-d892-4d51-8976-84ce9966392f/manager/0.log"
Oct 30 04:20:05.760505 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:05.760476    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-69b7bb8c5c-vd7pn_8479926b-9133-4823-b552-0f31a2db5282/manager/0.log"
Oct 30 04:20:07.825558 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.825527    4869 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"]
Oct 30 04:20:07.826181 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.826158    4869 cpu_manager.go:414] "containerMap: removing container" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main"
Oct 30 04:20:07.826224 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.826185    4869 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main"
Oct 30 04:20:07.826302 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.826288    4869 memory_manager.go:365] "RemoveStaleState removing state" podUID="805de359-6b23-4c34-ba33-7ab0172d0f95" containerName="main"
Oct 30 04:20:07.830080 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.830063    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:07.843090 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.843069    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-mxbgt_bce09833-e763-408f-bd70-4c15801d184b/cluster-monitoring-operator/0.log"
Oct 30 04:20:07.845386 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.845367    4869 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lgh6m\"/\"default-dockercfg-bgns5\""
Oct 30 04:20:07.848811 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.848792    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"]
Oct 30 04:20:07.934707 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.934679    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgh6m\"/\"kube-root-ca.crt\""
Oct 30 04:20:07.934805 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.934749    4869 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgh6m\"/\"openshift-service-ca.crt\""
Oct 30 04:20:07.945033 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.944999    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-sys\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:07.945121 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.945051    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-proc\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:07.945193 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.945172    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-podres\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:07.945249 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.945237    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-lib-modules\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:07.945285 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:07.945257    4869 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbh8v\" (UniqueName: \"kubernetes.io/projected/29ab2229-137b-431a-ab9c-0a353e068e10-kube-api-access-rbh8v\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.045954 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.045926    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-proc\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.045970    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-podres\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046007    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-lib-modules\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046024    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbh8v\" (UniqueName: \"kubernetes.io/projected/29ab2229-137b-431a-ab9c-0a353e068e10-kube-api-access-rbh8v\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046035    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-proc\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046056 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046043    4869 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-sys\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046221 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046118    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-lib-modules\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046221 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046123    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-podres\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.046221 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.046184    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ab2229-137b-431a-ab9c-0a353e068e10-sys\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.068668 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.068642    4869 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbh8v\" (UniqueName: \"kubernetes.io/projected/29ab2229-137b-431a-ab9c-0a353e068e10-kube-api-access-rbh8v\") pod \"perf-node-gather-daemonset-c6s2s\" (UID: \"29ab2229-137b-431a-ab9c-0a353e068e10\") " pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.143699 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.143649    4869 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.456229 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.456200    4869 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"]
Oct 30 04:20:08.458297 ip-10-0-136-202 kubenswrapper[4869]: W1030 04:20:08.458265    4869 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29ab2229_137b_431a_ab9c_0a353e068e10.slice/crio-3b5146334b6c32971afb86e2b82263a4d57d080ba3ea00696d053bf200783855 WatchSource:0}: Error finding container 3b5146334b6c32971afb86e2b82263a4d57d080ba3ea00696d053bf200783855: Status 404 returned error can't find the container with id 3b5146334b6c32971afb86e2b82263a4d57d080ba3ea00696d053bf200783855
Oct 30 04:20:08.756661 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.756592    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s" event={"ID":"29ab2229-137b-431a-ab9c-0a353e068e10","Type":"ContainerStarted","Data":"ac1b18509e8232fce75e51ba7137d4f85d4f36fa2a64f853958b145d3a7c36c6"}
Oct 30 04:20:08.756802 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.756659    4869 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s" event={"ID":"29ab2229-137b-431a-ab9c-0a353e068e10","Type":"ContainerStarted","Data":"3b5146334b6c32971afb86e2b82263a4d57d080ba3ea00696d053bf200783855"}
Oct 30 04:20:08.756802 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.756690    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:08.796177 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.796133    4869 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s" podStartSLOduration=1.796119247 podStartE2EDuration="1.796119247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:20:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:20:08.795132326 +0000 UTC m=+5078.116712044" watchObservedRunningTime="2026-10-30 04:20:08.796119247 +0000 UTC m=+5078.117698966"
Oct 30 04:20:08.965385 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:08.965358    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfc5t_bc031a43-a635-42ac-a6a8-92a7d5a05c34/node-exporter/0.log"
Oct 30 04:20:09.080947 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:09.080902    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfc5t_bc031a43-a635-42ac-a6a8-92a7d5a05c34/kube-rbac-proxy/0.log"
Oct 30 04:20:09.201713 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:09.201693    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfc5t_bc031a43-a635-42ac-a6a8-92a7d5a05c34/init-textfile/0.log"
Oct 30 04:20:13.651959 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:13.651878    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-xzlxr_3a1f4153-3d9d-418e-8834-2495c11521c1/networking-console-plugin/0.log"
Oct 30 04:20:14.715154 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:14.715122    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/2.log"
Oct 30 04:20:14.719233 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:14.719212    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-54724_7cd6aa53-869a-4820-beb5-dd8a2d819fda/console-operator/3.log"
Oct 30 04:20:14.772156 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:14.772130    4869 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lgh6m/perf-node-gather-daemonset-c6s2s"
Oct 30 04:20:16.902593 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:16.902546    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-2wmxc_5869efa1-9154-450e-a09b-710f9a51dcfc/volume-data-source-validator/0.log"
Oct 30 04:20:19.284626 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:19.284593    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2p4k_28695845-d672-425c-9848-4d6894a5427f/dns/0.log"
Oct 30 04:20:19.400024 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:19.399993    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2p4k_28695845-d672-425c-9848-4d6894a5427f/kube-rbac-proxy/0.log"
Oct 30 04:20:20.003626 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:20.003565    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6n4q9_8814d09f-6e78-4cb5-9536-16527a4b1d30/dns-node-resolver/0.log"
Oct 30 04:20:21.869198 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:21.869151    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s56gp_18b6b191-b504-4b31-add7-fdc98bea9aec/node-ca/0.log"
Oct 30 04:20:22.553113 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:22.553076    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-l7g8g_8c198945-756e-4bd5-9fee-ae06c5e590b9/discovery/0.log"
Oct 30 04:20:22.589905 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:22.589871    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k_e76ada6b-6390-464d-80cf-d3634469236b/istio-proxy/0.log"
Oct 30 04:20:22.714137 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:22.714113    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w_5ce2b215-ba2a-4684-b910-bdb48267fd97/istio-proxy/0.log"
Oct 30 04:20:23.157239 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:23.157210    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft_efdea12c-a38d-4bf1-942d-343574781453/istio-proxy/0.log"
Oct 30 04:20:23.225242 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:23.225216    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8b5c987-q7zgf_2a895e88-4ff6-436e-9e50-dcff54933988/router/0.log"
Oct 30 04:20:23.915334 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:23.915301    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-l7g8g_8c198945-756e-4bd5-9fee-ae06c5e590b9/discovery/0.log"
Oct 30 04:20:24.012886 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:24.012855    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k_e76ada6b-6390-464d-80cf-d3634469236b/istio-proxy/0.log"
Oct 30 04:20:24.257387 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:24.257351    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w_5ce2b215-ba2a-4684-b910-bdb48267fd97/istio-proxy/0.log"
Oct 30 04:20:25.112109 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.112077    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft_efdea12c-a38d-4bf1-942d-343574781453/istio-proxy/0.log"
Oct 30 04:20:25.212355 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.212327    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-l7g8g_8c198945-756e-4bd5-9fee-ae06c5e590b9/discovery/0.log"
Oct 30 04:20:25.233770 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.233743    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8b5c987-q7zgf_2a895e88-4ff6-436e-9e50-dcff54933988/router/0.log"
Oct 30 04:20:25.255044 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.255021    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-6wz4k_e76ada6b-6390-464d-80cf-d3634469236b/istio-proxy/0.log"
Oct 30 04:20:25.386607 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.386540    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-bfm4w_5ce2b215-ba2a-4684-b910-bdb48267fd97/istio-proxy/0.log"
Oct 30 04:20:25.834488 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.834460    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-5b4f8cc59b-wvgft_efdea12c-a38d-4bf1-942d-343574781453/istio-proxy/0.log"
Oct 30 04:20:25.900225 ip-10-0-136-202 kubenswrapper[4869]: I1030 04:20:25.900199    4869 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8b5c987-q7zgf_2a895e88-4ff6-436e-9e50-dcff54933988/router/0.log"